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ABSTRACT 

An  annotated  bibliography  on  operator  mental  workload  is  presented  with 
suppot  tag  information.  This  bibliography  is  based  upon  two  literature  searches, 
one  performed  in  1977  in  support  of  a  iiurvey  and  analysis  catalog  (AD  / 159-501) 
and  one  performed  in  1979  as  an  update. 

Each  literature  citation  presented  contains  reference  information,  an  abstract, 
a  numerical  workload  technique  category  classification,  a  numerical  operator 
behavior  classification,  and  a  group  of  word  descriptors.  Workload  methods  are 
divided  into  28  specific  techniques  in  four  major  categories:  opinion,  spare  mental 
capacity,  primary  task,  and  physiological.  Applicable  operator  behaviors  are 
similarly  divided  into  categories. 

The  descriptors  associated  with  each  citation  designate  the  general  workload 
classification,  the  specific  workload  classification,  t*ie  type  of  presentation,  the 
type  of  facilities  used,  and  the  potential  aircrew  application.  Over  600  citations 
are  presented.  Two  indexes  are  also  provided.  The  first  is  a  workload  technique 
index  and  the  second  is  an  experimental  facility  index.  It  is  concluded  that 
periodic  updating  of  the  bibliography  will  be  required  and  that  attention  should  be 
directed  toward  computerizing  future  workload  bibliographies. 
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INTRODUCTION 


1.1  BACKGROUND 

Technological  advances  in  aircraft  systems  daring  the  past  several  decades 
have  resulted  in  sophisticated  avionics  and  weapons  delivery  subsystems  which  are 
available  to  aid  the  aircrew  in  completing  specified  missions.  The  ultimate  mission 
success  of  today's  military  aircraft,  however,  still  rests  on  a  common  factor,  the 
human  operator.  To  b»  effective,  modern  aircraft  systems,  with  all  of  their 
advanced  sensors  and  avionics,  must  be  compatible  with  the  capabilities  and 
limitations  of  the  aircrew. 

During  the  design,  development,  test,  and  evaluation  of  any  new  aircraft 
system,  caie  must  be  taken  to  insure  that  the  new  system  does  not  place 
unreasonable  demands  on  the  aircrew  by  overwhelming  them  with  too  much 
information  end  too  little  time  to  process  that  information.  Such  considerations 
are  often  characterized  as  assessing  mental  workload. 

It  has  gener-liy  been  recognized  that  mental  workload  assessment  or  measure¬ 
ment  is  a  difficult  problem.  First,  there  axe  difficulties  in  defining  mental 
workload  Second,  there  are  difficulties  in  finding  the  available  technology  and  in 
selecting  appropriate  techniques  for  measurement  in  any  given  application.  And 
finally,  there  are  difficulties  with  the  workload  assessment  methods  themselves. 
Problems  exist  in  the  areas  of  sensitivity,  intrusion,  transferability,  reliability,  and 
validity. 

The  literature  of  mental  workload  is  diverse  and  the  terminology  varies.  What 
one  researcher  may  call  mental  workload,  another  may  call  attentiona!  demand  or 
cognitive  load.  Most  of  the  work  is  recent  and  it  appears  in  proceedings,  journals, 
and  reports  from  many  parts  of  the  world.  Furthermore,  there  are  numerous 
studies  in  progress,  requiring  that  any  literature  search  be  updated  periodically  if  it 
is  to  remain  current. 

Because  of  the  importance  of  workload  assessment  in  test  and  evaluation  of 
aircraft  and  avionics  systems  and  because  of  the  diversity  of  workload  literature, 
the  Naval  Air  Station,  Patuxent  River,  Maryland,  tasxed  Systemetrics,  Incorpo¬ 
rated,  to  study  the  available  literature  on  operator  mental  workload.  That  initial 
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study  was  undertaken  in  August  1977  and  was  concluded  in  September  1978.  The 
project  final  report  contained  references  to  more  than  400  workload  documents. 
The  report  also  included  workload  technique  and  operator  behavior  classification 
schemes  along  with  brief  descriptions  and  typical  citations  for  each  known  method 
of  workload  estimation,  some  28  methods  in  all. 

The  original  survey  and  analysis  report  was  printed  in  ISO  copies,  all  of  which 
were  distributed  among  workload  researchers  and  users  within  a  few  months. 
Because  of  the  demand  for  the  document,  a  second  printing  in  125  copies  was 
ordered.  Almost  all  of  those  copies  have  also  been  distributed.  It  is  very  clear 
that  the  demand  for  documents  summarizing  and  cataloging  workload  estimation 
techniques  is  high. 

In  preparation  for  the  survey  and  analysis  report,  each  document  selected  for 
inclusion  in  the  reference  section  was  first  abstracted  and  categorized.  Numerical 
indexes  ar.d  word  descriptors  were  included.  Each  citation  with  its  abstract, 
numerical  indexes,  and  word  descriptors  was  then  typed,  on  a  5x8  inch  index  card. 
The  purpose  of  the  cards  was  to  aid  in  writing  the  survey  and  analysis  report  and  to 
provide  a  more  detailed  record  that  could  be  edited  and  published  subsequently. 
Such  a  record  would  provide  more  detailed  information  on  what  is  contained  ' 
each  workload  document  and,  if  published,  would  be  of  substantial  value  to 
workload  technique  users  and  researchers. 

Originally  the  plan  was  to  publish  the  abstract  cards  as  a  companion  document 
to  the  survey  and  analysis  report.  However,  when  this  task  was  undertaken  in  June 
1979,  it  appeared  prudent  to  update  the  original  search  and  abstract  all  recently 
available  documents  prior  to  publishing  the  bibliography.  It  must  be  remembered 
that  workload  estimation  is  an  active  research  area  and  new  documents  appear 
frequently.  Also,  the  original  cards  required  updating  and  editing.  Many 
documents  which  were  cited  as  presentations  at  meeting:;  had  subsequently  been 
published  in  journal  or  book  form.  Furthermore,  experience  gained  in  the 
abstracting  process  could  be  used  to  increase  the  u.iiformiiy  of  indexing  and 
descriptor  notations. 

This  report,  therefore,  contains  an  updated,  annotated  bibliography  of  mental 
workload  estimation  techniques.  All  known  documents  meeting  the  selection 
criteria  described  in  Section  i.3  and  available  in  1979  or  earlier  have  been 
included.*  There  are  more  than  600  citations. 

While  it  would  be  helpful  to  read  the  earlier  survey  and  analysis  report,  the 
present  report  does  stand  by  itself  and  contains  all  necessary  formating  informa¬ 
tion  regarding  the  annotated  bibliography.  It  also  contains  a  description  of  the 
manner  in  which  the  searches  were  conducted. 

^Wierwille,  W.  W.  and  Williges,  R.  C.,  Survey  and  Analysis  of  Operator  Workload 
Assessmei  t  Techniques,  Final  Report.  Blacksburg,  Virginia:  Systemetrics,  Inc., 
5-78-101,  September  1978  (Contract  1*00*21-77-0-0083)  (AD  A059-501). 

♦Certain  1979  dated  documents  may  not  be  contained,  however,  because  of  their 
publication  lags. 


2 


SY-27R-80 


1.2  SEARCH  PROCEDURE 

To  accomplish  a  comprehensive  search  of  the  scientific  literature  dealing  with 
various  methods  of  ass  sing  mental  workload,  several  sources  were  used.  The 
potential  sources  of  both  foreign  and  domestic  literature  that  were  searched 
included  books,  scientific  journals,  technical  reports,  and  proceedings  of  technical 
meetings.  Computerized  information  retrieval,  library  searches,  and  direct  con¬ 
tacts  with  the  scientific  community  were  used  to  locate  relevant  documents. 

1.2.1  INITIAL  SEARCH 

Computerized  Information  Retrieval 

To  provide  an  initial  pool  of  workload  documents,  several  computerized 
information  search  and  retrieval  systems  were  used.  Most  of  these  searches  are 
based  on  key  word  accessing  of  documents  contained  in  the  files.  The  user  must 
develop  an  appropriate  key  word  index  and  then  use  various  logical  expressions  in 
an  iterative  fashion  to  combine  these  key  words  appropriately.  The  initial  list  of 
key  words  chosen  for  use  is  presented  in  table  I.  Subsequently,  subsets  of  these 
words  were  used  in  individual  computerized  searches. 

DIALOG  system.  First,  a  nationwide,  interactive  information  system  was 
searched  through  direct  telephone  access.  The  particular  system  used  is  called 
DIALOG  and  provides  50  computer  files  pertaining  to  science,  technology/ 
engineering,  social  sciences  (humanities),  and  business/economics.  Complete 
reference  citations,  accession  numbers  for  ordering  references,  and  abstracts  are 
readily  available  on  request  through  the  National  Technical  Information  Service 
(NTIS). 

Searches  of  three  files,  COMPENDEX  (Engineering  Index),  NTIS  including 
Defense  Technical  Information  Center  (DTIC),  and  PSYCHOLOGICAL  ABSTRACTS 
(American  Psychological  Association),  were  conducted  on  DIALOG.  This  search 
provided  more  than  900  titles  that  contained  potential  information  on  mental 
workload. 

DTIC  report  bibliography.  The  literature  contained  in  the  dialog  system 
includes  primarily  reports  published  within  the  last  10  years.  To  provide  a  more 
comprehensive  survey  of  the  technical  report  literature,  a  broad  coverage  survey 
of  DUG  files  was  requested  covering  human  operator  workload  measurement 
methodology,  research,  and  applications  to  human  operator/machine  systems. 
Specifically,  requests  were  made  for  annotated  bibliographies,  including  AD 
numbers,  which  cover  the  broad  human  factors,  aircrew  systems,  man-machine 
relations,  psychology,  personnel  evaluations,  and  stress/physiology  areas.  Three 
report  bibliographies  were1  obtained  from  DTIC  covering  the  periods  1947-1957, 
1957-1967,  and  1967-1977,  respectively.  These  three  bibliographies  combined 
resulted  n  a  list  of  over  300  titles. 
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Workload 

Workload  Estimation 
Spare  Mental  Capacity 
Human  Information  Rate 
Psychological  Stress 
Stress  Due  to  Workload 
Stress  Due  to  Overloading 
Mental  Stress 
Human  Operator  Workload 
Operator  Workload 
Secondary  Task 
Auxiliary  Task 
Primary  Task 


List  of  Key  Words 

Difficulty  of  Operator  Tasks 
Subsidiary  Tasks 
Attentional  Demand 
Pilot  Workload 
Mental  Load 
Perceptual  Loading 
Reserve  Capacity 

Time  Sharing  Response  of  Human  Operators 

Pilot  (Mental)  Fatigue 

Task  Induced  Stress 

Task  Difficulty  (Measurement  Of) 

Sensory  Overloading 
Physiological  Stress 


a 


Human  Information  Processing  Rate  Information  Capacity  (Of  the  Human 

Operators) 


Operator  Loading 
Operator  Channel  Capacity 
Human  Operator  Channel  Capacity 
Extra  Task  Performance 
Task  Induced  Stress 
Physiological  Measu-es  of  Stress 


Time  Sharing 
Pilot  Time  Sharing 
Secondary  Tasks 
Residual  Capacity 
Residual  Attention 
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CDIC  library.  A  search  similar  to  the  one  described  for  DTTC  reports  was 
requested  from  the  Control  Display  Information  Center  (CDIC'  library  at  the  Air 
Force  Flight  Dynamics  Laboratory,  Wright-Patterson  Air  Force  Base,  Ohio.  This 
library  has  a  unique  listing  of  human  fartors-related  documents  pertaining  to 
aircrew  environments  not  normally  found  in  the  open  literature.  Abstracts  of  27 
references  were  obtained  from  this  search. 

Iuits  library.  Many  of  the  elder  human  factors  documents  are  available 
through  the  Tufts  library  collection  which  is  now  housed  at  Johns  Hopkins 
University.  Dr.  Stanley  Lippert,  who  developed  a  computerized  search  of  the 
complete  Tufts  bibliography,  searched  the  files  according  to  the  key  word  structure 
used  on  the  other  computerized  searches.  Unfortunately,  these  specific  terms  did 
not  appear  in  the  Tufts  bibliography  to  any  great  extent.  Therefore,  the  Tufts 
bibliography  published  by  the  Human  Engineering  Laboratories,  Aberdeen  Proving 
Ground,  Maryland,  was  manually  searched. 

Library  Searches 

Computerized  searches  are  not  exhaustive,  largely  because  many  of  the 
reference  sources  are  not  included  in  the  files.  This  is  particularly  true  for 
proceedings  of  professional  meetings  such  as  the  Humar  Factors  Society  and  the 
Annual  Conference  on  Manual  Control.  To  supplement  the  computerized  retrieval, 
an  extensive  library  search  was  made  of  several  abstracting  documents  including 
Ergonomics  Abstracts  (which  includes  proceedings  of  technical  meetings),  Journal 
Supplement  Abstract  Service  of  the  American  Psychological  Association, 
Psychological  Abstracts,  and  Dissertation  Abstracts  as  well  as  selected  journals 
such  as  Acta  Psychologica,  AIIS  Transactions,  American  Psychologist,  Applied 
Ergonomics,  Aviation,  Space,  and  Environmental  Medicine,  Ergonomics,  British 
Journal  of  Psychology,  Canadian  Journal  of  Psychology,  Human  Factors,  IEEE 
Transactions  of  Man-Machine  Systems,  IEEE  Transactions  on  Systems,  Man,  and 
Cybernetics.  Journal  of  Experimental  Psychology,  Journal  of  Motor  Behaviot, 
Organizational  Behavior  and  Human  Performance,  Perception  and  Psychophysics, 
Perceptual  and  Motor  Skills,  Psychological  Bulletin,  and  Psychological  Review. 

Two  additional  library  holdings  were  also  included  in  the  literature  search. 
One  library  was  the  existing  bibliography  pertaining  to  workload  assessment 
methodologies  which  was  maintained  by  Dr.  S,  G.  Schiflett  at  the  Naval  Air  Test 
Centev,  Patuxent  River,  Maryland.  The  other  libray  was  the  AGARD  index  and 
report  holdings  maintained  by  Dr.  J.  F.  Pollard  of  the  Biological  and  Medical 
Sciences  Division  of  the  Office  of  Naval  Research  in  Washington,  D.C.  Over  2000 
pages  of  indexing  were  searched  in  this  library  holding  the  AGARD  Index  of 
Publications  from  1952-1976. 

Contacts  wit h  the  Scientific  Community 

Several  direct  contacts  were  initiated  with  members  of  the  scientific 
community  currently  involved  in  workload  assessment  methodology.  Three  sub¬ 
groups  of  individuals  were  mailed  requests  for  reprints  of  their  contributions  to  the 
field.  Specifically,  letters  were  mailed  to  six  members  of  the  TriService  T&E 
Technical  Advisory  Group,  eight  members  involved  in  the  TriService/NASA 
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Operator-Crew  Workload  activities,  and  52  individual  scientists  who  were  known  to 
have  teen  involved  in  workload-related  research.  The  response  received  from 
these  requests  was  most  gratifying  and  provided  a  valuable  source  of  information. 

In  addition,  site  visits  were  made  to  the  Naval  Aerospace  Medical  Research 
Laboratory  (NAMRL)  facilities  at  Pensacola,  Florida,  and  New  Orleans,  Louisiana, 
to  discuss  current  workload-related  research  activities. 

1.2.2  UPDATE  SEARCH 

The  update  search  was  planned  to  provide  maximum  access  to  workload 
literature  that  had  become  available  between  1977  and  1979.  This  search  was 
optimized  on  the  basis  of  experience  with  the  initial  search  and  consisted  of  three 
main  components:  computerized  information  retrieval,  library  searches,  and 
inquiries  in  the  scientific  community.  E’.ch  of  these  components  yielded  substan¬ 
tial  numbers  of  document  citations  having  a  bearing  on  workload. 

Computerized  Information  Retrieval 

A  procedure  similar  to  that  used  earlier  was  followed  for  the  computerized 
search.  The  DIALOG  system  was  again  used  as  the  main  source  of  information. 
Limits,  however,  were  placed  on  dates  of  documents  retrieved,  with  documents 
appearing  prior  to  1975  being  eliminated.  Allowance  for  the  yearns  1975  to  1977 
was  considered  appropriate  because  of  possible  lags  between  document  dates  and 
actual  appearance,  plus  time  to  enter  the  compufcrized  information  data  base. 

The  DIALOG  search  included  searches  of  COMPENDEX  (Engineering  Index), 
NHS  including  DTIC  files,  and  PSYCHOLOGICAL  ABSTRACTS  (American 
Psychological  Association).  A  set  of  logical  expressions  made  up  from  the  list  of 
key  words  appearing  in  table  I  was  again  developed  for  the  search.  This  was 
performed  on  line  so  that  the  number  and  type  of  titles  obtained  could  be  adjusted 
prior  to  complete  printout  of  all  titles.  The  procedure  increased  the  efficiency  of 
the  search  substantially.  In  total,  approximately  300  initial  citations  were 
obtained. 

In  parallel  with  the  DIALOG  search,  the  National  Aeronautics  and  Space 
Administration  was  requested  to  perform  a  seach  of  their  Scientific  and  Technical 
Information  Office  computerized  information  system  in  Washington,  D.C.  A  list  of 
key  words  was  provided.  Because  NASA  had  not  participated  in  the  initial  search, 
citations  dating  back  io  1970  were  requested.  This  search  resulted  in  another  300 
citations.  However,  because  of  NASA's  extensive,  direct  experience  with  pilot  and 
astronaut  workload  problems,  this  search  provided  a  high  yield  of  new  documents 
meeting  the  selection  criteiK-  Several  of  the  documents  cited  were  from  foreign 
sources  and  had  not  appea*  .d  through  the  other  information  retrieval  sources. 

Library  Searches 

Because  computerized  searches  cannot  be  considered  exhaustive,  a  direct 
iibrary  search  was  instituted  again  in  the  update.  The  search  was  conducted  in  the 
same  way  as  the  earlier  search,  th~*  is,  including  abstracting  documents  and 
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journals  and  pioceedir.gs  known  to  be  published  on  the  subject  of  operator 
workload.  The  publications  and  abstracting  documents  searched  were  essentially 
the  same  as  those  mentioned  in  the  original  library  search  (Section  1.2.1). 

Contacts  with  the  Scientific  Community 

The  list  of  individuals  to  whom  initial  requests  for  documents  had  been  mailed 
was  updated.  In  addition,  the  Human  Factors  Society  Directory  was  searched  for 
individuals  who  included  operator  workload  (or  similar  terminology)  as  one  of  their 
technical  specialities.  Also,  contacts  at  technical  meetings  provided  the  names  of 
additional  individuals.  In  total,  approximately  100  letters  were  sent  requesting 
documents  and  information  on  workload  publications  for  the  years  1977  through 
1979.  The  cooperation  of  the  workload  community  was  very  encouraging  anti 
netted  approximately  100  technical  papers,  reports,  and  citations. 

1.2.3  DOCUMENT  RETRIEVAL 

On  the  basis  of  the  titles  and  abstracts  obtained  from  the  search,  documents 
appearing  to  meet  the  selection  criteria  were  ordered  from  NTIS  or  were  otherwise 
obtained  in  a  single  copy.  Approximately  80%  of  the  documents  cited  in  this 
bibliography  were  classified  or.  the  basis  of  the  entire  document.  In  the  remaining 
cases,  the  documents  were  classified  on  the  basis  of  the  abstract  and  any  other 
information,  such  as  telephone  calls  to  authors  or  direct  knowledge  of  the  ongoing 
work.  It  was  felt  that  classification  based  on  all  available  information  would  be 
more  advantageous  to  the  reader  than  no  classification  when  the  full  document  was 
not  available.  While  such  a  procedure  may  result  in  some  slight  inaccuracies  in  the 
classifications,  these  are  believed  to  be  minor. 

1.3  SELECTION  CRITERIA 

Given  the  large  pool  of  documents  obtained  by  the  combined  search  proce¬ 
dures,  it  was  necessary  to  develop  a  set  of  criteria  for  inclusion  of  a  reference  in 
the  final  bibliography.  Both  a  peneral  set  of  criteria  as  well  as  a  specific  set  of 
criteria  were  adopted. 

General  Criteria 


For  a  document  to  be  included,  it  had  to  satisfy  the  criteria  listed  in  this 
section. 


A.  Topic.  Each  document  had  to  be  applicable  to,  deal  wi*h.  or  apply 
workload  concepts.  Workload  here  is  used  in  a  general  sense  and  includes 
the  terms:  spare  mental  capacity,  residual  attention,  mental  load,  etc. 
The  term  "workload"  or  similar  terms  need  not  explicitly  appear  in  the 
document  provided  that  a  description  similar  to  workload  appears  and  is 
used. 


A.l.  Topic  discrimination.  Each  document  had  to  involve  mental  work¬ 
load,  as  opposed  to  physical  workload  (physical  labor,  for  example) 
vr  hardware  workload  (computer  workload,  for  example). 
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A.2.  Topic  clarification.  Mental  workload  is  assumed  to  occur  when  a 
human  operator  performs  perceptual,  mediational,  communication, 
or  motor  processes,  or  any  combination  thereof. 

A.3.  Topic  background.  A  document  providing  essential  background 
needed  for  development  of  a  mental  workload  concept  as  presented 
in  a  later  document  or  a  parallel  document  was  included. 

B.  Subject  population.  Each  document  had  to  describe  work  with  or  be 
applicable  to  normal  adults.  Studies  dealing  with  specific  groups  of 
normal  adults  such  as  drivers,  females,  trained  system  operators,  and 
pilots  were  included.  Studies  dealing  with  nonhumans,  nonadults,  and 
adults  with  physical  or  mental  disabilities  or  debilitating  diseases  were 
not  included. 

C.  Application.  Each  document  had  to  be  at  least  potentially  applicable  to 
aircrew  mental  workload  assessment  in  simulation,  in  flight  test,  or  as 
background  information. 

D.  Level  of  contribution.  Each  document  had  to  contribute  to  the  scientific 
understanding  of  mental  workload  and  its  measurement. 

E.  Existence.  A  full  copy  of  each  document  must  exist  in  print  or  in 
copyable  form.  Documents  appearing  in  summary,  with  sufficient  detail 
to  make  them  usable,  and  meeting  all  other  necessary  criteria  as  listed 
here,  were  included.  Documents  appearing  in  short  abstract  only, 
personal  communications,  and  verbal  presentations  were  not  included. 

Specific  Criteria 

For  a  document  to  be  included,  it  also  had  to  meet  at  least  one  of  the  criteria 
listed  in  this  section. 

A.  Measurement  techniques.  A  document  relating  mental  workload  to  any 
other  measurable  variable  was  included. 

B.  Constructs  and  models.  A  document  involving  philosophical  or  mathemat¬ 
ical  constructs  or  models  was  included  only  if  mental  workload  was  at 
least,  potentially  assessable  from  the  constructs  or  models. 

C.  Experimental  design.  A  document  involving  human  operator  loading  was 
included  only  if  specific  implications  were  made  regarding  mental  work¬ 
load  concepts.  (Human  operator  loading  is  defined  here  as  an  indepentu  j.t 
variable,  that  is,  any  controlled  change  in  experimental  conditions  that 
may  result  in  changes  in  operator  behavior.) 

D.  Design  methodology.  A  document  involving  design  methodologies 
(methods  engineering  in  industrial  engineering,  or  workspace  design  in 
human  factors  engineering,  for  example)  was  included  only  if  specific 
implications  were  made  regarding  mental  workload  concepts. 
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CLASSIFICATION  SCHEME 


The  classification  scheme  used  for  the  annotated  bibliography  was  developed 
to  provide  information  to  the  user  or  researcher  regarding  the  type  or  types  of 
workload  estimation  employed  in  the  cited  document  and  the  range  of  operator 
behaviors  to  which  the  document  may  be  applicable.  Additional  information  in  the 
form  of  w._.d  descriptors  also  appears.  The  descriptors  provide  information  on  the 
type  o;'  document,  facilities  used,  and  potential  applications.  Once  the  reader 
understands  the  classification  scheme,  it  should  be  possible  to  determine  whether 
or  not  a  given  document  has  bearing  on  a  specific  workload  problem  at  hand. 

2.1  WORKLOAD  CLASSIFICATION 

The  most  important  dimension  in  the  classification  scheme  is  the  workload 
classification  dimension.  The  literature  on  workload  is  so  diverse  that  categoriza¬ 
tion  on  the  part  of  the  reader  of  this  literature  is  almost  intuitive.  It  is,  however, 
important  to  select  a  categorization  which  groups  the  various  workload  techniques 
in  a  logical  way  so  that  conflicts  and  discrepancies  on  workload  concepts  are 
minimized.  The  taxonomy  of  workload  methods  that  evolved  from  the  documents 
reviewed  is  presented  in  table  II  along  with  a  graduated  numbering  designation. 
Basically,  the  various  methods  are  grouped  into  four  major  categories  (subjective 
opinion,  spare  mental  capacity,  primary  task  assessment,  and  physiological 
measures)  which  are  further  subdivided  into  28  individual  techniques.  Each  of 
these  specific  techniques  as  well  as  the  higher-order  classification  terms  are 
described  in  detail  in  Section  4  of  the  earlier  survey  and  analysis  report. 

In  the  bibliography  which  follows,  reference  to  the  workload  dimension  appears 
directly  below  the  abstract  as  a  numerical  classification  entitled  "W/L  Cat.  Code." 
Table  IH  shows  a  typical  citation.  The  numbers  appearing  in  this  classification 
refer  to  the  workload  techniques  described  in  the  document.  The  numbers 
correspond  to  the  numbers  appearing  in  table  H.  In  the  example,  two  workload 
techniques  are  cited.  The  first  is  2.2.4,  a  secondary  task  of  an  adaptive  type  using 
either  an  arithmetic  or  a  logic  task.  The  second  is  3.1,  measures  taken  from  the 
primary  task,  analyzed  individually  or  singly. 

It  should  be  noted  that  in  many  documents  emphasis  is  on  one  workload 
technique,  but  additional  measures  are  also  taken  or  discussed  in  detail.  When  this 
occurs,  all  techniques  receiving  appreciable  coverage  are  included  in  the  workload 
classification. 
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Table  D 

Classification  of  Workload  Methodologies  Dimension 


1.  Subjective  Opinion 


3.  Primary  Task 


1.1  Rating  Scales 

.1.2  Interviews  and  Questionnaires 

f  2.1.1  Task 
'2.1  Task  Analytic  < 


2.  Spare  Mental  Capacity; 


r  2.1.1 

Task  Component,  Time  Summation 

l  2.1.2 

Information-Theoretic 

f2.2.1 

Nonadaptive,  Arithmetic/Logic 

2.2.2 

Nonadaptive,  Tracking 

l  2.2.3 

Time  Estimation 

1  2.2.4 

Adaptive,  Arithmetic/Logic 

1.2.2. 5 

Adaptive,  Tracking 

2.3  Occlusion 

3.1  Single  Measures 

3.2  Multiple  Measures 

3.3  Math  Modeling 


,4.1.1 

FFF 

4.1.2 

GSR 

4.1.3 

ek  ■;.} 

4.1.4 

EMG 

14.1.5 

EEG 

4.1.6 

ECP 

4.1.7 

Eye  aid  Eyelid  Movement 

4.1.8 

Pupillary  Dilation 

4.1.9 

Muscle  Tension,  Tremor 

4.  Physiological  Measures , 


4.1.10  Heart  Rate,  Heart  Rate  Variability, 
Blood  Pressure 

4.1.11  Breathing  Analysis 

4.1.12  Body  Fluid  Analysis 

4.1.13  Handwriting  Analysis 


4.2  Combined  Physiological  Measures 

4.3  Speech  Pattern  Analysis 
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Table  HI 

Example  of  Annotated  Bibliography  Format 
Using  a  5x8  Inch  Index  Card 

Krause,  E.  F.  and  Roscoe,  S.  N.,  Reorganization  of  Airplane  Manual  Flight  Control 
Dynamics.  W.  B.  Knowles,  M.  S.  Sanders,  and  F.  A.  Muckier  (eds.),  Proceedings  of 
the  Sixteenth  Annual  Meeting  of  the  Human  Factors  Society.  Santa  Monica, 
California:  Human  Factors  Society,  1972,  117-126. 

Experiments  were  conducted  in  a  Singer-Link  GAT-2  simulator  to  evaluate  the 
effectiveness  of  a  system  providing  direct  control  over  aircraft  maneuvering 
performance.  Pilots  performed  complex  navigational  tasks  involving  the  use  of  a 
computer-assisted  area  navigation  system.  Changing  way-point  storage  capacity  of 
the  simulated  navigation  system  induced  variable  task  loading  on  subjects.  The 
experiment  was  replicated  with  and  without  an  adaptive,  digit  processing,  side  task 
to  determine  levels  of  residual  attention  associated  with  the  control  modifications 
and  the  varying  levels  of  workload.  The  flight  performance  controller  yielded 
greater  precision  of  maneuvering  control,  fewer  procedural  blunders,  and  an 
increased  level  of  residual  pilot  attention. 

W/L  Cat.  Code:  2.2.4,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 


Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulation 
Primary  task  Single  measures  Flight  test 
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2.2  OPERATOR  BEHAVIOR  CLASSIFICATION 

The  purpose  of  the  operator  behavior  classification  is  to  provide  information 
to  the  reader  on  the  range  of  operator  behaviors  or  tasks  described  or  employed  in 
the  cited  workload  document.  To  attain  this  purpose,  it  is  necessary  to  categorize 
or  otherwise  classify  operator  behavior  in  systems. 

The  range  of  operator  behaviors  and  their  taxonomies  have  been  investigated 
for  several  years.  These  taxonomies  have  been  uaed  to  obtain  an  understanding  of 
what  functions  an  operator  performs  in  a  system  and  as  a  basis  for  task  analysis. 
One  widely  used  listing  of  operator  behaviors  was  developed  by  Ber linger,  Angell, 
and  Shearer  (1964). 2  This  approach  breaks  operator  behavior  into  four  major 
processes  (perceptual,  mediational,  communication,  and  motor)  as  shown  in 
table  IV.  TTiese  four  major  processes  are  further  subdivided  into  seven  activities 
and  then  into  47  operator  behaviors.  This  classification  yields  good  agreement 
among  investigators  in  determining  specific  behaviors  of  operators  in  systems. 
Consequently,  this  approach  was  used  to  classify  operator  behaviors. 

Early  in  the  process  of  classifying  documents  for  the  survey  and  analysis 
report,  it  became  evident  that  the  literature  on  operator  workload  did  not  lend 
itself  to  a  highly  detailed  categorization  of  operator  behaviors.  Generally,  the 
literature  could  only  be  classified  dowt  to  the  second  level  of  detail.  Conse¬ 
quently,  the  literature  was  classified  only  according  to  the  four  major  processes 
and  seven  activities  shown  in  table  IV,  instead  of  the  47  behaviors.  Even  at  this 
less-refined  level  of  analysis,  classification  of  the  literature  according  to  the 
operator  behaviors  dimension  appeared  more  subjective  and  unreliable  than  classi¬ 
fication  in  terms  of  workload  technique. 

The  second  line  below  the  abstract  designated  "Op.  Behav.  Code"  contains  the 
behavior  classification.  In  the  example  of  table  ID,  the  general  categories  of 
operator  behaviors  described  in  the  document  are  1.  Searching  and  identifying 
types  of  perceptual  processes,  2.  Information  processing  and  problem  solving  types 
of  mediational  processes,  and  4.  Simple  and  complex  types  of  motor  processes. 


2 

Berliner,  C.,  Angen,  D.,  and  Shearer,  D.  J.,  Behaviors,  Measures,  and  Instruments 
for  Performance  Evaluation  m  Simulated  Environments.  Paper  presented  at  the 
Symposium  and  Workshop  on  the  Quantification  of  Human  Performance, 
Albuquerque,  New  Mexico,  August  1964. 
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Table  IV 


Classification  of  Universal  Operator  Behavior  Dimension 
(After  Berliner,  Angell,  and  Shearer,  1964) 


Proceeaea 


1.  Perceptual  processes 


Activities 


1.1  Searching  for  and 

receiving  information 


1.2  Identifying  objects, 
actions,  events 


Specific  Behavior 

1.1.1  Detects 

1.1.2  Inspects 

1.1.3  Observes 

1.1.4  Reads 

1.1.5  Receives 

1.1.6  Scans 

1.1.7  Surveys 


s' 1.2.1  Discriminates 
<  1.2,2  Identifies 
v.  1.2.3  Locates 


2.1  Information  processing 


2.  Mediations!  processes 


2.1.1  Categorizes 

2.1.2  Calculates 
2  1.3  Cedes 
2.1.4  Computes 
2.1.£  Interpolates 

2.1.6  Itemizes 

2.1.7  Tabulates 

2.1.8  Translates 


2.2  Problem  solving  and 
decision-making 


^2.2.1  Analyzes 

2.2.2  Calculates 

2.2.3  Chooses 

<  2.2.4  Compares 
I  2.2.5  Computes 
■  2.2.6  Estimates 
1^2.2.?  Pirns 


Communication  processes 


4.1  Simpla/Discrete 


4.  Motor  processes 


4.2  Complex/Continuous 


3.1  Advises 

3.2  Answers 

3.3  Communicates 

3.4  Directs 

3.5  Indicates 

3.6  Informs 

3.7  Instructs 
3.6  Requests 
3.9  Transmits 

4.1.1  Activates 

4.1.2  Closes 

4.1.3  Connects 

4.1.4  Disconnects 

4.1.5  Joins 

4.1.6  Moves 

4.1.7  Presses 

4.1.8  Sets 

4.2.1  Adjusts 

4.2.2  Aligns 

4.2.3  Regulates 

4.2.4  Synchronizes 

4.2.5  Tracks 
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2.3  WORD  DESCRIPTORS 

lit  addition  to  the  numerical  classifications  tor  workload  technique  and 
operator  behaviors,  each  citation  v.  as  also  classified  according  to  five  categories 
by  means  of  short  word  descriptors.  The  purpose  of  these  descriptors  was  to 
convey  information  to  the  reader  quickly  on  the  details  of  the  cited  document. 

At  the  bottom  of  each  citation,  five  columns  of  descriptors  appear.  Goir.g 
from  left  to  right,  the  first  two  columns  provide  wo.kioad  technique  classification 
information  in  easily  recognizable  form.  The  first  column  ind'cates  which  of  the 
four  major  categories  of  workload  estimation  are  described.  The  entries  in  this 
column  correspond  exactly  to  those  of  the  first  column  of  table  n.  The  second 
column  of  each  citation  provides  a  detailed  description  of  the  workload  techniques 
employed  and  represents  a  hybrid  description  of  the  second  and  third  columns  of 
table  1L  Consequently,  the  descriptors  in  table  II  ha*»e  been  changed  in  some  cases 
to  provide  the  maximum  infer’  at  ion  in  the  least  space.  Also,  in  the  second 
column,  when  five  oi  more  workloi  i  techniques  have  been  employed  or  described  in 
one  document,  the  term  "multiple''  has  been  used. 

The  third  column  specifies  the  type  of  presentation,  as  either  Review, 
Construct,  Experimental,  or  some  combination.  Documents  presenting  a  brief 
review  prior  to  developing  a  construct  or  describing  an  experiment  were  not  given 
the  Review  desigi ation. 

The  fourth  column  lists  the  experimental  facilities  used  in  the  experiments 
described.  In  the  case  of  review  articles,  if  the  review  refers  in  a  substantial  way 
to  earlier  experiments,  the  facilities  associated  with  those  experiments  are 
designated.  Co  the  other  hand,  if  the  review  does  not  extensively  describe  earlier 
experiments,  no  facilities  are  designated.  Entries  in  this  column  consist  of  None  or 
tome  combination  of  Laboratory*,  Field,  Simulator,  Flight  simulator,  and  Flight 
test. 

The  fifth  column  describes  the  potential  aircrew  application  environment. 
Those  documents  providing  background  information  indirectly  applicable  to  aircrew 
problems  were  der'gnated  by  tne  term  Background.  The  regaining  documents  were 
classified  as  containing  information  having  direct  bearing  in  "Flight  simulator" 
experiments  >r  "Flight  test"  experiments,  or  both. 


If  the  experimental  facility  was  a  computer,  the  designation  Laboratory  was  used. 
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CONCLUDING  REMARKS 


The  main  purpose  of  th«  remarks  in  this  suction  is  to  aid  researchers  who  may 
become  involved  in  future  workload  literature  reviews  or  who  wish  to  gain  greater 
insight  into  the  current  review.  Several  matters  have  become  apparent  as  a  result 
of  completing  this  annotated  bibliography  and  the  earlier  survey  and  analysis 
report. 

First*  it  is  clear  that  mental  workload  estimation  is  an  active  field  of 
research.  The  fact  that  200  additional  references  were  found  between  1977  and 
1979  attests  to  this.  It  is  suggested  that  search  updates  should  be  made  in  each 
biennium.  While  timing  is  not  critical*  to  wait  mere  than  three  years  to  perform  an 
update  may  again  result  in  a  task  of  enormous  magnitude.  When  performing  such  a 
search*  it  is  important  to  allow  time  overlap  with  any  previous  search.  Overlap 
allows  inclusion  of  publications  which  are  dated  prior  to  actual  availability.  Also* 
as  indicated  earlier,  some  papers  presented  at  technical  meetings  eventually 
appear  in  journals*  proceedings,  and  books,  and  it  is  helpful  to  the  reader  to  list  the 
most  accessible  citation. 

As  the  si3£  of  this  document  demonstrates,  something  should  be  done  to  make 
the  workload  Literature  more  manageable.  Probably  this  document  is  the  maximum 
usable  size,  and  future  updates  should  be  tied  in  with  computerising  the  citations. 
Initial  work  in  this  area  is  underway  using  the  New  Jersey  Institute  of  Technology 
Telenet  System  (Electronic  Information  Exchange  System).  However,  this  work 
represents  a  feasibility  study.  A  more  permanent  approach  needs  to  be  developed 
that  could  be  used  for  the  next  two  decades.  The  approach  should  allow  additions* 
editing*  indexing*  and  cross-referencing  by  authorized  personnel  as  well  as 
accessing*  read  out,  and  print  out  by  researchers  and  users. 

Additional  work  should  be  done  on  bounding  the  topic  of  mental  workload. 
While  the  selection  criteria  presented  in  Section  1.3  have  worked  well  in  most 
cases*  certain  problems  remain.  Foremost  among  these  is  the  need  for  a  better 
definition  of  "essential  background.'1  At  present,  whether  or  not  r  document  should 
be  included  because  It  represents  essential  background  is  entirely  a  matter  of 
judgment.  To  illustrate  the  difficulty,  consider  the  secondary  task  method  of 
workload  estimation  and  its  relationship  to  dual-task  performance  studied  by 
experimental  psychologists.  There  are  at  least  a  thousand  publications  dealing  with 
dual-tasks.  They  address  many  aspects,  including  sense  modalities*  timing* 
instructions,  cognitive  processing,  and  interference.  Their  relationship  to  secondary 
tasks  is  on  a  continuum.  Some  provide  more  usable  background  than  others*  and  If 
ia  difficult  to  decide  which  to  include  and  which  to  exclude. 
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Aleo  .a  terms  o i  bounding  workload,  more  attention  should  be  <jiven  io  what 
might  be  termed  subsidiary  defiu*  Mona.  Mmtal  workload  itself  can  be  considered  as 
a  global  term.  As  an  analogy,  consider  the  word  "automation."  It  has  distinct 
meanlag  and  yet  conjures  up  different  images  to  different  people.  It  appears  that 
mental  workload  has  this  problem  also.  By  carefully  defining  subsidiary  categories 
that  minimise  overlap,  prograss  might  be  mads  toward  resolving  the  difficulties  in 
defining  workload. 

Lastly,  a  problem  remains  in  terras  of  applicability  of  the  literature.  The 
survey  and  analysis  report  and  this  annotated  bibliography  both  use  the  "universal 
operator  behaviors*  approach  aa  an  applications  dimension.  However,  most 
literature  cuts  across  two,  three,  and,  in  some  cases,  all  four  of  the  major 
categories  of  oparator  behaviors.  Consequently,  the  information  contained  in  the 
"Op.  Behav.  Code"  notation  is  quite  general.  Future  reviews  should  address 
refinements  or  alternatives  to  assessing  applicability. 
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Adams,  R.  J.  and  Rich,  P.  RNAV  waypoint  charting  effects  on  pilot  procadurcs, 
training  and  workload.  In  Proceedings,  National  Aerospace  Meeting.  Denver, 

Color.  April  13,  14,  1977,  31-37.  (Washington,  D.C.:  Institute  of  Navigation). 

A  summary  la  presented  of  the  analytical  procedure  used  to  establish  waypoint 
charting  requirements .  From  this  theoretical  base,  the.  paper  Introduces  several 
currently  used  area  navigation  (RNAV)  Standard  Instrument  Department  (SID)  and 
Standard  Terminal  Arrival  Routes  (STAR).  The  advantages  gained  by  both  the  pilot 
and  air  traffic  control  system  through  the  proper  use  of  pilot  procedures  is 
quantified  by  using  detslled  flight  test  results  from  the  Miami,  Denver,  and 
Chicago  terminal  areaa  and  also  flight  simulator  results. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 

Flight  test  Flight  tust 


Akhutin.  V.  M. ,  Zlngerman,  A.  M. ,  Kislitoin,  M.  M.,  and  Menitskii,  D.  N.  Complex 
evaluation  of  the  functional  state  of  a  human  operator  in  control  systems. 

In  Optimization  of  the  professional  a<  tivity  o'.  ;  cosmonaut.  Moscow: 
I?.datel*stvo  Nauka „  1977,  234-244.  Tin  Russian.) 


A  study  of  the  psychophysiologlcal  reactions  of  human  operators  performing  control 
operations  has  indicated  two  forms  of  regulation  of  the  heart  beat  rate  by  the 
parasympathetic  nervous  system.  The  distinguishing  between  types  cf  regulatior 
confirms  an  analysis  based  on  EEG  indices  :nd  also  shews  the  usefulness  of  the 
sensory-motor  tracking  procedure  used  in  tta  psychophysiologlcal  study.  The  use 
of  the  experimental  data  to  establish  regulation  information  evaluation  criteria 
and  to  predict  the  dynamics  of  operator  turns ion  is  considered. 

W/L  Cat.  Code:  3.1,  4.1.3,  4.1.5,  4.1.10 


Op.  Behav.  Code:  1.2,  4.2 


Primary  task 
Physiological 


Single  measures  Experimental  Laboratory 

EEG 

EKG 

Heart  rate, 
h.r.  var. 


Flight  simulator 
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Albaneso,  R.A.  Mathemat i cal  analysis  and  computer  simulation  in  military 

mission  workload  assessment.  Proceedings  of  the  AG ARP  Conference  on  Methods 
to  Afiseas  Workload,  AGAFD-CPP-216 ,  April,  1977,  A13-1  -  A13-6. 

This  paper  discusses  mathematical  and  computer  approaches  to  the  assessment  of 
crew  workload  during  military  missions.  Three  analysis  tools  are  discussed:  (1) 
estimation  algorithms,  (2)  linear  models,  and  (3)  nonlinear/hybrid  models.  These 
separate  but  interacting  methods  provide  increasing  levels  of  detail  in  an 
analysis,  but  require  increasing  levels  of  effort  to  obtain  a  result.  A  central 
element  in  this  presentation  is  emphasis  on  the  notion  that  a  significant 
measure  of  crew  workload  is  acceptable  accomplishment  of  the  mission  plan. 
Mathematical  analysis  and  computer  simulation,  properly  employed,  provide 
several  measures  of  workload  to  the  investigator.  Including  mission  sccomplish- 


ment  measures. 

W/L  Cat .  Code : 

Op.  Behev.  Code: 

Primary  task 

3.1,  3.3 

1. ,  2. ,  3. ,  4. 

Single  measures 

Construct 

None 

Flight 

simulator 

Math,  modeling 

Flight 

test 

Albanese,  R.  A.  Quantitative  military  workload  analysis.  In  B.  0.  Hartman  and 
R.  E.  McKenzie  (Eds.)  Survey  of  methods  to  assess  workload r  AGARJV-4.G-246, 
August,  1979,  69-71. 

This  report  discusses  a  method  of  tradeoff  analysis  as  applied  to  workload  analysis 
in  the  military  environment.  It  is  suggested  that  workload  studies  be  performed 
in  a  tradeoff  setting  which  allows  the  analyst  to  estimate  the  return  on  invest¬ 
ment  he  has  earned  through  his  proposed  system  modifications.  The  methodologies 
described  employ  mathematical  modeling  techniques.  It  Is  emphasized  that  these 
techniques  are  an  adjunct  to,  and  not  a  replacement  of,  more  traditional  methods 
of  workload  analysis. 

W/L  Cat.  Code:  3.1,  3.3 


Op.  fiehav.  Code:  1.,  2. 

Primary  task  Single  "ensures  Construct  None  Background 

Math,  model 


# 
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Allen,  R.W. ,  Jex,  H.R. ,  McF.uer,  O.T.  end  DiMarco-  R. J.  Alcohol  effects  on 
driving  behavior  and  performance  In  a  cat  simulator.  IEEE  Transactions  on 
Systems,  Man,  and  Cybernetics-  19/5,  SHC-5 ,  498-505. 

A  fixed-base  simulation  was  developed  to  test  the  effect  of  alcohol  on  driving 
performance.  Measurements  of  both  driver  control  behavior  and  driver-vehicle 
performance  were  obtained  for  the  steering  task,  and  detection  and  recognition 
Indexes  and  reaction  tine  were  measured  on  the  discrete  task.  Preliminary  results 
on  scanning  behavior  are  also  presented.  Alcohol  causes  larger  l^ne  and  heading 
deviations,  and  Increases  detection  and  reaction  times  on  the  discrete  task. 

Both  continuous  steering  control  and  discrete  peripheral  'sign"  response  tasks 
were  performed,  singly  and  combined,  to  investigate  the  effects  of  divided 
attention,,  Performance  on  the  steering  contol  task  was  decreased  when  both  tasks 
were  done  concurrently,  but  the  sensitivity  to  alcohol  effects  was  similar. 


W/L  Cat .  Code : 

Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 
Physiological 


2.2.1,  3.1,  4.1.7 
1  .  ,  2.  ,  4  . 
Subsidiary  task 
Single  measure 
Eye  movement 


Experimental 


Simulator  Flight  simulator 
Flight  test 


Allport,  D.  A.,  Antonis,  B.  and  Reynolds,  P.  On  the  division  of  attentions  a 
disproof  of  the  single  channel  hypothesis.  Quarterly  Journal  of  Experimental 
Psychology,  1972,  24,  225-233. 

In  dichotic  listening,  subjects  are  apparently  unable  to  attend  simultaneously 
to  two  concurrent,  auditory  speech  messages.  However,  in  two  experinents 
reported  here,  it  is  shown  that  people  can  attend  to  and  repeat  back  continuous 
speech  at  the  same  time  as  taking  In  complex,  unrelated  visual  scenes,  or  even 
while  sight-reading  piano  music.  In  both  cases  performance  with  divided 
attention  was  very  good,  and  in  the  case  of  sight-reading  was  as  good  as  with 
undivided  attention.  There  was  little  or  no  effect  of  the  dual  task  on  the 
accuracy  of  speech  shadowing.  These  results  are  incompatible  With  the 
hypothesis  that  human  attention  Is  limited  by  the  capacity  of  a  general-purpose 
central  processor  in  the  nervous  system.  An  alternative,  "multi -channel”, 
hypothesis  is  outlined. 

W/L  Cat.  Code:  2.2.1,  3.1 

op.  Behav.  Code:  1.,  2.,  3. 

Spare  in.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 
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mulsi,  E.  A.  and  Morgan,  B.  B.,  Jr.  Effects  of  practice  and  work  load  on  the 
performance  of  a  code  transformation  task.  (COTRAN) .  Moffett  Field,  California: 
National  Aeronautics  and  Space  Administration,  Contractor’s  Report  NASA  CR-1261 , 


1969. 


V 

6 

I 

I 

I 

I 

T 


The  effects  of  practice  and  operator  workload  on  the  acquisition 
end  performance  of  a  code-transformation  (COTRAN)  task  are  reported.  The  COTRAN 
taek  was  developed  previously  (cf.  Alluisi  &  Coates,  1967)  to  provide  a  means  for 
obtaining  performance  measurements  of  that  part  of  Intellectual  functioning  which  is 
typically  called  "non-verbal  mediation";  it  follows  the  problem-solving  paradigm. 

The  experiment  was  conducted  in  two  phases.  During  the  first,  or  acquisition  phase, 

27  COTRAN  problems  were  solved  on  each  of  four  (Group-4,  with  four  subjects),  eight 
(Group-8,  with  twenty  subjects),  or  twelve  (Group-12,  with  four  subjects;)  successive 
days.  Performance  reached  asymptotic  levels  in  four  to  six  sessions,  in  general, 
and  tl  »  differences  in  final  levels  of  performance  of  the  three  groups  (4,  8,  and  12) 
were  not  statistically  significant.  During  the  second,  or  transfer  phase  of  the  study, 
each  of  the  28  subjects  solved  27  COTRAN  problems  on  each  of  five  successive  days 
while  time-sharing  the  COTRAN  task  with  different  combinations  of  tasks  selected  from 
a  multiple-task  performance  battery.  The  results  Indicate  that  skilled  COTRAN 
performance  is  sensitive  to  at  least  two  or  three  levels  of  workload  stress,  and 
that  different  subjects  may  tend  to  adopt  different  strategies  in  time-sharing  the 
COTRAN  task  with  other  tasks. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  2. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measure 
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Alluisi,  E.  A.  and  Morgan,  B.  B. ,  Jr.  Effects  of  sustained  performance  of 
time-sharing  a  three-phase  code  transformation  task  (3P-C0TRAN). 

Perceptual  and  Motor  Skills,  1971,  3j3,  639-651. 

The  3P-C0TRAN  task  was  time-shared  with  5  different  combinations  of  tasks 
selected  from  a  multiple-taok  perfor  ance  battery  (MTPB)  used  in  a  synthetic- 
work  approach  to  the  study  of  work  behavior  or  sustained  performance  (Alluisi, 
1969) .  20  Ss  previously  trained  to  a  high  level  of  skill  on  the  3P-COTRAN 

task  were  divided  at  random  into  5  groups  of  4  Ss,  each  of  which  then  time- 
shared  the  task  with  a  different  combination  of  MTPB  tasks.  Results  were 
analyzed  in  terms  of  both  the  effects  cf  the  time-sharing  on  the  3P-C0TRAN 
performances,  and  the  effects  of  3P-C0TRAN  on  the  time-shared  MTPB  performances. 
Evidence  of  the  adoption  of  different  response  strategies  to  time-shared  tasks, 
especially  under  conditions  of  operator  overload,  or  workload  or  performance 
stress,  was  found,  and  the  methodological  implications  of  this  finding  are 
discussed. 

W/L  Cat.  Code:  2.2.1,  2.2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spava  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 
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Anderson,  D.  B.  and  Chiou,  W.  C.  Physiological  parameters  associated  with  extended 
helicopter  flight  missions:  an  assessment  of  puplllographic  date.  Fort  Rucker, 
Alabama:  U.S.  Army  Aeromedlcal  Research  laboratory,  USARRL  no.  77-21,  Final 
report,  September,  1577.  (AD  A052  771). 

Six  Army  aviators  were  used  to  study  various  psychological  and  phyniological 
parameters  of  flight  fatigue.  This  study  reports  the  characteristics  of  the 
pupillary  reflex  response  to  light  and  of  the  pupillary  amplitude  variation.  It 
was  found  that  the  waveform  characteristics  of  the  pupillary  reflex  response  to 
light  were  relatively  Irregular.  Qualitative  analyses  revealed  that  the  blinking 
rate  increases  and  the  pupillary  amplitude  varies  as  a  function  of  loaded  flight 
task.  The  avetage  pupillary  diameter  was  smaller  in  the  morning  than  in  the 
evening.  Results  from  this  study  should  be  evaluated  with  other  potential  flight 
fatigue  parameters  such  as  the  blcod  and  urine  tests,  EKG,  etc.  to  derive  more 
meaningful  interpretations  of  the  complex  underlying  flight  fatigue  mechanism. 


W/L  Cat.  Code: 


4.1,7,  4.1.8 


Op.  Behav.  Code:  1. 


Physiological  Eyelid  movement  Experimental  laboratory  Background 


Pupillary  dia. 


Anderson,  P.  A.  and  Toivanen,  M.  L.  Effects  of  varying  levels  of  autopilot 
assistance  and  workload  on  pilot  performance  in  the  helicopter  formation 
flight  mode  Washington,  D.C.t  US  Office  of  naval.  Research,  JANAIR  680610, 
March,  1970. 

The  objective  of  this  study  was  co  evaluate  pilot  performance  in  manual  IFR 
formation  flight  tilth  varying  levels  of  autopilot  assistance  and  pilot  workload. 
Han-in-the-lcop  simulations  of  these  vehicles  were  conducted  to  evaluate  pilot 
performance  undt-.r  six  levels  of  autopilot  assistance,  and  three  levels  of  pilot 
workload,  consisting  of  a  forced-pace,  secondary  concomitant  task.  Results  of 
this  study  indicated  that  increasing  the  level  of  autopilot  assistance  resulted 
in  a  less  demanding  task  for  the  pilct  and  provided  greater  system  stability. 

This  was  borne  out  in  terms  of  both  quantitative  performance  data  and  pilot 
opinion.  Only  at  the  highest  workload  level  tested  did  autopilot  assistance 
serve  to  reduce  the  position  errors  from  what  was  experienced  under  the  manual 
control  conditions. 

W/L  Cat.  Code:  1.2,  2.2.1,  3.1 

Op.  3ehav.  Code:  1.,  2.,  4. 

Opinion  Questionnaire  Experimental  Flight  simulator  flight  simulator 

Spare  m.  capacity  Subsidiary  task  Flight  test 

Primary  task  Single  measures 
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Armstrong,  G.C.,  Sana,  D.D.,  McDowell,  J.W.  and  Winter,  F.J.,  Jr.  Pilot 

factory  for  helicopter  pre-experimental  phase.  Randolph  AFB,  Texas:  USAF 
Instrument  Flight  Center,  IFC-TR-74-2,  February,  1975. 

This  investigation  was  conducted  to  establish  the  methods  and  procedures,  to 
collect  pilot  factors  Information,  and  to  obtain  firsthand  pilot  opinions  anf 
judgments  concerning  the  present  control-display  systems  installed  In  helicopters. 
Four  Instrument  Instructor  pilots  were  used  as  test  subjects,  and  seven  data 
gathering  sorties  were  accomplished.  The  profiles  flown  represented  typical 
helicopter  Instrument  maneuvers.  The  pilot /subject  activity  required  In 
performance  of  the  maneuver  segments  was  designed  to  progress  from  simple  t  xs 
to  complex  tusks.  Objective  and  subjective  data  were  obtained  through  the  i  „<s  of 
video,  audio,  and  oscillograph  recording  equipment.  This  *tudy  documents  the 
characteristics  and  trends  of  the  control  and  display  devices  as  Installed  In  a 
light  to  medium  utility  helicopter. 

W/L  Cat.  Code:  1.1,  3.2 

Op.  Uehav.  Code:  1.,  2.,  3.,  4. 

Opinion  Mult,  measures  Experimental  Flight  test  Flight  simulator 

Primary  task  Flight  test 


As  J  :1a,  C.F.  Advanced  man-machine  evaluation  techniques.  Paper  presented  at 
the  American  Defense  Preparedness  Association,  Huntsville,  Alabama, 
November  12-13,  1975. 


Recent  design/ Integration  efforts  have  provided  an  advanced  man/machine 
evaluation  technique  that  focuses  on  (1)  advanced  fighter  performance,  (2) 
mission  analysis,  (3)  functional  allocation  analysis,  (4)  task  analysis,  (5) 
anthropometric/visual  link  analysis,  (6)  static  design  aid  evaluation,  (7) 
digital  pilot  simulation  model,  and  (8)  flight  (man-m-the-loop)  simulation. 

This  advanced  technique  provides  a  tangible  basis  for  development  and  assurance 
of  an  optimized,  Integrated  cockpit  and  traceability  of  man-machine  design 
decisions.  Current  research  efforts  have  included  the  development  of  pilot 
performance  model  techniques  that  evaluate  the  impact  of  alternate  crew  station 
and  weapon  delivery  configurations  on  pilot  workload.  In  addition,  simulated 
mission  profiles  have,  yielded  valuable  information  on  the  head  end  eye  motion  and 
workload  of  operational  pilots. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


2.1.1,  2.1.2,  3.3 
1. ,  2. ,  3. ,  4. 
Task  comp . , 
time  assess. 
Matn.  model 


4.1.7 

Review  None 


Flight  simulator 
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Aaiala,  C.  F. ,  Loy,  S.  L.  and  Quinn,  T.  J.  Digital  simulation  nodal  for  fighter 
pilot  workload.  St.  Louis,  Missouri :  McDonnell  Aircraft  Conpany ,  MDC  A0058, 
Septenber,  1969. 

The  Pilot  Simulation  Model  (PSM)  was  developed  by  McDonnell  Douglas  to  evaluate 
workload  and  alaslon  success  factors  in  developmental  aircraft.  It  has  been 
applied  to  a  n unbar  of  nilitacy  system  studies  such  as  A-6E  TRAM,  A- 7 ,  F-15, 
Advanced  Tactical  System  (ATS),  Digital  Plight  Control  System  (DFCS),  Advanced 
Fighter  technology  Integration  (AFTI),  F-18  and  the  Harrier.  The  last  two  Are 
currently  undergoing  periodic  model  Iterations  in  response  to  design  updates. 

The  PSM  is  used  primarily  to  fill  the  evaluation  gap  between  paper-and-pancil 
and  manned  simulation,  in  situations  where  system  design  status  justifies  e  more 
comprehensive  technique  than  papar-and-pencil  but  does  not  necessarily  require  a 
manned  simulation  approach.  Tha  model  provides  a  detailed  workload  analysis  by 
task  by  modality  (e.g. ,  hand,  eye,  Information  processing),  and  equipment  utilized. 
To  accomplish  this  effectively,  both  a  functional  task  flow  and  a  task  by  modality 
by  task  time  analysis  must  be  performed. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Task  coop..  Construct  Laboratory  Flight  simulator 

time  assess. 

Experimental 


Asset,  A.  M.,  Batejat,  D.»  Papin,  J.  P.  and  Viard,  D.  Investigation  of  pilot 

behavior  in  flight-analysis  of  Japanese  studies.  Revue  de  Medicine  Aeronautique 
at  Spaclale,  1976,  15,  62-66.  (In  French.) 

This  paper  describes  Japanese  investigations  involving  analysis  of  pilot  behavior 
during  air  flight  with  the  purpose  of  estimating  pilot  workload  and  performance 
complexity.  Major  aspects  discussed  concern  a  description  of  the  activity  network 
in  the  man/machine  system,  temporal  course  of  pilot  behavior  in  this  system, 
development  of  measurement  techniques  for  evaluating  pilot  behavior,  and  data 
analysis  and  workload  estimation. 

W/L  Cat.  Code:  2.1.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Teak  comp..  Review  None  Background 

time  assess. 

Primary  task  Single  measures 
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Auffret,  R.  Studies  on  pilot  world  oad-paychophyaiological  factors.  Proceedings 
of  AGARD  Conference  on  Studies  on  Pilot  Workload,  AGARD-CP-217,  Aprils  1577. 

The  different  variables  which  can  influence  huaan  performance  during  the 
operational  use  of  helicopters  or  other  aircraft  having  high  acceleration  loads 
are  assessed  to  quantify  the  sum  of  work  which  can  be  provided  at  each  moment 
during  flight. 

W/L  Cat.  Code: 

Op.  Behav.  Code: 

Spare  m.  capacity 

Primary  task 


4.1 

lay  2. y  4. 

Task  comp..  Construct 

time  assess. 

Single  measures 


Auffret,  R. ,  Serls,  H.,  Berthoz,  A.  and  Fatras,  B.  Estimate  of  the  perceptive 
load  by  variability  of  rate  of  heartbeat:  Application  to  a  piloting  task. 
Le  Travail  Humaln,  1967,  80,  309-310. 

The  load  undergone  by  a  subject  during  aircrew  work  is  essentially 
perceptive.  Its  estimate  is  necessary  for  the  human  factors  engineering 
study  of  an  operator  station.  With  this  goal  in  mind  ve  have  studied  the 
rate  of  nulse  beat  and  its  variability.  This  method  doer;  not  degrade  the 
performance  of  the  subject.  The  measurement  of  the  variability  of  the 
Instantaneous  cardiac  frequency  appears  a  useful  criterion  in  view  cf  the 
computation  of  the  load  or  the  detection  of  the  variations  of  load  during 
pilot  work.  The  data  reduction  should  be  carried  out  vlth  a  minimum  accuracy 
of  5  ms.  Establishing  means  over  long  time  periods  can  mask  modifications 
in  variability. 

W/L  Cat.  Code:  4.1.10 

Op.  Behav.  Code:  1..  2.,  4. 


Physiological  Heart  rate, 
h.i.  var. 


Experimental  Laboratory 
Flight  test 


Flight  simulator 
Flight  test 


lehrlck,  H.  P. ,  Moble,  M,  and  Fitts,  F.  M. 
of  learning  a  primary  taak.  Journal  of 
298-302. 


Extra-tiak  performance  ac  a  measure 
Experimental  Psychology,  1954,  48, 


Tba  prasant  study  was  undertaken  to  dataraine  whether  performance  on  a 
secondary  task,  practiced  simultaneously  with  a  primary  task,  can  serve  to 
reveal  learning  on  the  primary  task,  that  is  not  revealed  by  conventional 
measures  on  the  primary  taak  itself.  The  study  was  bassd  on  the  widely 
held  notion  that  with  continued  practice  tasks  become  less  susceptible  to 
interference.  To  teat  this  hypothesis,  Ss  were  trained  either  in  a 
repetitive  or  in  a  random  version  of  a  motor  taak.  The  two  versions  were 
adjusted  in  such  a  way  that  a  primary  taak  performance  index  of  the  various 
groups  remained  st  s  ccmp arable  level  at  aach  stage  of  training.  Concurrent 
performance  of  an  extra  task  was  required  either  early  or  late  in  practice 
on  both  versions  of  the  motor  taak.  The  results  showed  that,  extra-task 
(arithmetic)  performance  late  in  practice  was  superior  to  extra-task  performance 
rly  In  practice  when  the  sequence  of  stimuli  in  the  concurrent  motor  task  was 
repetitive.  No  such  difference  occurred  when  the  motor  task  was  random.  Since 
scores  on  the  motor  task  itself  remained  comparable  at  different  levels  of 
training  for  the  random  and  repetitive  groups,  these  results  support  the 
hypothesis  that  extra-task  performance  can  b?  used  to  measure  certain  kinds 
of  Improvement  on  a  primary  task  which  are  not  evident  from  conventional 
score'  that  taak  itself. 

W/L  C  .  Code:  2.2.1 

Op.  Behav.  Code:  1.,  4. 

c.  capacity  Subsidiary  task  Experimental  Laboratory  Background 


aainbrxdge,  L.  Forgotten  alternatives  in  skill  and  work-load.  Ergonomics . 
1978,  21,  169-185. 

This  pap  suggests  that  the  nature  of  process  control  skill  lies  in  the 
change  decision  making  made  possible  with  increased  knowledge  of  process 
behaviv.  During  learning;  feedback  about  process  output  indicates  that 
the  process  needs  correcting,  and  also  that  the  operator  must  adjust  his 
choice  of  action.  An  experienced  operator  knows  the  correct  error-action 
alignment,  so  has  less  need' to  check  and  correct  both  the  process  and  his 
own  beha^'or.  He  has  a  lower  workload  and  a  larger  task  capacity.  Choice 
of  appropriate  control  actions  requires  knowledge  of  the  effects  of  his  own 
behavior  as  well  as  that  of  the  process,  and  assessment  of  the  task  context. 

If  behavior  ia  chosen  to  maintain  the  operator's  mental  and  physical  state, 
as  well  as  to  maintain  the  process,  this  requires  further  knowledge  about 
his  own  potential  behavior,  his  internal  state,  and  criteria  for  acceptability 
of  his  own  state.  High  taak  demands  may  lead  to  performance  breakdown  because 
they  cause  unfamiliar  decision  situations,  so  the  operator  is  returned  to 
inexperienced.  Lass  effective  types  of  behavior. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Single  measures  Construct  None  Background 


n 
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Baker,  D.  L.  and  Intano,  G.  P.  Helicopter  yaw  axis  augmentation  luvastlgatloti  - 
CDG-FFH-4.  Randolph  APB,  Taxaa*  USAF  Instrument  Cliche  Center,  t/C  Tost  Plan 
74-11,  December,  1974. 

A  tost  plan  Is  presented  for  a  flight  tsst,  The  objectives  of  the  helicopter 
yaw  axis  augmentation  Investigation  ere  to  determine  the  amount  of  change  in 
performance  pilot  activity  and  pilot  acceptance  by  augmenting  the  yaw  axis;  determine 
the  value  of  a  heading-hold  feature  during  hover,  take-off,  climbs,  descent,  and 
cruise;  and  to  assess  the  degree  of  value  of  tu'^n  coordination  when  climbing, 
descending,  and  level  turns  are  executed.  A  series  of  in-flight,  postflight, 
and  subject  pilot  questionnaire  trill  be  used. 

W/L  Cat.  Coda:  1.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Questionnaire  Construct  None  Flight  test 

Flight  simulator 


Barnes,  J.  A.  Use  of  eye-movement  measures  to  establish  design  parameters  for 
helicopter  instrument  panels.  Proceedings  of  the  AGARD  Conference  on  Methods 
to  Assess  Workload,  AGARD-CPP-216 ,  April,  1977,  A3-1  -  A3-8. 

Recording  the  pilot's  eye-scan  paths  and  fixation  points  during  actual  helicopter 
flight  provides  an  Accurate  measure  of  the  visual  workload  imposed  by  a  particular 
panel  design.  This  tool  is  not  limited  to  aircraft  instrument  panels;  it  can  be 
used  to  evaluate  any  operator  control  panel  or  even  the  design  of  a  multi- 
information  display  within  a  panel.  Initial  work  was  done  in  the  UH-1  helicopter 
using  experienced  instrument-rated  pilots  flying  actual  maneuvers  o &  instruments. 
The  knowledge  gained  from  these  data  allowed  for  design  cf  a  helicopter  Instrument 
panel  in  which  the  most  referred  to  instruments  wer*.  placed  so  that  the  eye-scan 
paths  were  minimized.  This*  design  considerably  lessens  the  pilot’s  visual 
workload,  reduces  fatigue,  and  allows  more  time  for  other  tasks. 

W/L  Cat.  Code:  4.1.7 

Op.  Behav.  Code:  1.1,  2.1,  4.2 

Physiological  Eye  movement  Experimental  Flight  test  Flight  simulator 

Flight  test 
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Baron ,  S.  and  Ls\ison,  H.  H.  An  opt inf 1  control  methodology  for  analysing  the 
erf acta  of  display  parameters  on  performance  and  workload  in  manual  flight 
control.  ISBI  Transactions  on  Syata— .  Man,  and  Cybernetics,  1975,  SMC -3 . 
423-430. 

An  approach  to  tha  analysis  of  the  effects  of  display  parameters  on  manual 
control  baaed  on  au  optimal  control  modal  of  the  human  operator  and  a  related 
model  for  task  interference  is  presented.  Tha  methodology  allows  one  to  predict 
tha  effects  of  changaa  in  display  variables  on  both  performance  and  attontional 
demand  or  workload.  The  methodology  la  applied  to  vertical  situation  displays 
for  STOL  approach-to-landing.  Both  status  displays  and  displays  of  command 
information  are  examined  and  compared  in  teams  of  approach  success  probability 
and  workload  requirement a. 

W/L  C*t.  Code:  3.3 

Op .  Behev .  Coda :  1.,  2.,  4. 

Primary  task  Math,  model  Construct  Laboratory  Flight  simulator 

Experimental 


Baron,  S. ,  Muralidharan,  1. ,  and  Xleinman,  D.  Closed  loop  models  for 

analyzing  the  effects  of  simulator  characteristics  -  pilot  performance/ 
workload  predictive.  In  Flight  Technologies  Conference,  Arlington,  Texas, 
September,  1978,  138-148.  (American  Institute  of  Aeronautics  and  Astronautics, 
New  York.) 

The  optimal  control  mod«l  (OCM)  of  th*»  human  operator  is  used  to  develop  closed- 
loop  models  for  analyzing  the  effects  of  (digital)  simulator  characteristics  on 
predicted  performance  and  workload.  Two  approaches  are  considered:  the  first 
utilizes  a  continuous  approximation  to  the  discrete  simulation  in  conjunction  with 
the  standard  optimal  control  model;  the  second  involves  a  more  exact  discrete 
description  of  the  simulator  in  a  closed-loop  multi-rate  simulation  in  which  the 
optimal  control  model  'simulates*  the  pilot  Both  models  predict  that  simulator 
characteristics  can  have  significant  effects  on  performance  and  workload. 

W/L  Cat.  Code:  3.3 

Op.  Behav.  Code:  l.„  2.,  4. 

Pilr«ary  task  Math,  model  Construct  None  Flight  simulator 


SY-27R-80 


Baschara,  P.  and  Grardjean,  I.  Bf facta  of  repetitive  choice  reaction  tasks  on 
activation  laval  and  subjective  stata.  ?*per  presentad  at  tha  7th  Congrasa 
of  tha  International  Ergonoaica  Association,  Warsaw,  Poland,  August  27-31,  1979. 

Tha  offacts  of  repetitive  choica  reaction  tasks  with  different  degrees  of  difficulty 
on  activation  level  and  subjective  stata  were  investigated.  As  indices  of 
activation  level  critical  flicker  frequaucy  and  heart  rata  variability  were 
used-  subjective  state  was  studied  with  a  questionnaire.  The  tack  with  the  lowest 
degree  of  difficulty  produced  the  greatest  decrease  ii  Cl  K  and  the  saalleut 
impairment  of  aids j active  stata.  Tha  task  with  *h#  highest  degree  of  difficulty 
also  producsd  a  large  dacraaaa  in  CFF,  but  it  greatly  impaired  subjective  stata. 
Heart  rata  variability  increased  most  on  the  task  with  the  lowest  degree  of 
difficulty. 

W/L  Cat.  Code:  1.2,  4.1.1,  4.1.10 

Op.  Behav.  Code:  1.,  2.,  4.1 

Opinion  Questionnaire  Experimental  Laboratory  Background 

Physiological  FFF 

Heart  rate, 
h.r.  var. 


Bate,  A..T.  and  Self,  H.C.  Effects  of  simulated  task  loading  on  side-looking 
radar  target  recognition.  Wright-Pat ter son  AFB,  Ohio:  Aerospace  Medical 
Kese&rch  Laboratory,  aMRL-TR-67-141,  June,  1968.  (AD  673873) 

Thie  study  was  conducted  to  determine  the  effects  of  simulated  task  loads  that 
prevented  observers  from  devoting  all  of  their  time  to  searching  a  radar  display 
for  targets  of  opportunity.  Task  loads  taking  up  OX,  25X,  50X  and  75X  of 
observers'  screen  viewing  time  were  simulated  by  turning  the  display  on  and  off 
In  a  programmed  random  pattern.  The  radar  picture  depicted  a  strip  of  terrain 
25-nautical-miles  wide  and  traveled  from  the  top  to  the  bottom  of  tho  screen  at 
a  simulated  aircraft  speed  of  1300  knots.  The  number  of  correct  responses  and 
number  of  false  responses  were  both  approximately  linear  functions  of  accumulated 
viewing  time.  Mean  distance  traveled  down  the  screen  by  targets  and  nontargets 
prior  to  responses  was  also  significantly  affected  by  viewing  time.  Since  the 
numbers  of  correct  <uid  false  responses  decreased  in  approximately  the  same 
proportion  with  each  decrease  in  viewing  time,  overall  accuracy  of  responses 
was  nearly  constant  for  all  viewing  times. 

W/L  Cat.  Code:  2,3,  3.1 

Op.  Behav.  Code:  1.,  2.,  3. 

Spare  m.  capacity  Occlusion  Experimental  Laboratory  Flight  simulator 

Primary  task  Single  measures 
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Batsman,  R.  P.  An  heuristic  approach  to  work  analysis.  Proc— dlnaa  of  tha  23rd 
Annual  Martina  of  the  Huaan  Factors  Sodaty.  Boston,  Hassachuaates,  October 
29  -  November  1,  1979,  554-557. 

Nina  experienced  pilots  served  as  subjects  in  an  experiment  designed  to  evaluate 
differences  between  multifunction  keyboards  by  esasuring  the  objective  performances 
of  she  subjects.  Subjects  performed  tracking  teaks  and  used  the  keyboards  for 
secondary  tasks.  Measurements  of  tracking  parameters  and  of  performance  time  and 
errors  using  the  keyboards  were  taken.  The  results  shewed  that  no  single  variable 
consistently  reflected  changer  In  task  difficulty.  The  observed  tendency  of 
subjects  to  employ  different,  changing  strategies  during  the  multiple  task 
performance  led  to  s  tentative  hypothesis  that  work  was  s  cr aposlta  of  all  of  tha 
parameters.  A  regression  analysis  was  used  to  develop  an  equation  with  weighting 
coefficients  for  the  parameters.  The  equation  vaa  found  to  be  in  agreemeut  with 
subjective  performance  evaluations. 

V/L  Cat.  Code:  1.1,  2.2.1,  3.1,  32. 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Spare  m.  capacity  Subsidiary  task 

Primary  task  Single  measures 

Multiple  measures 


Baty,  0.  L.  Human  transinformation  rates  during  one-to-four  axle  tracking  with 
a  concurrent  audio  teek.  Proceedings  of  the  7th  Annual  NASA-Unl varsity 
Conference  on  Manual  Control,  University  of  Southern  California,  June,  1971, 
2S3-30S-  (NASA  S?-28i). 

An  experiment  waa  conducted  to  determine  the  information  processing  rates  of 
six  subjects  performing  one-,  two-,  three-,  and  four-axis  compensatory 
tracking  tasks,  with  and  without  a  concurrent  four-choice  auditory  task.  The 
purpose  waa  to  obtain  further  evidence  concerning  the  nature  of  an  hypothesised 
celling  on  human  transinformation  rates.  Interference  was  found  among  tasks, 
but  the  evidence  concerning  a  ceiling  on  information  processing  rates  was 
inconclusive. 

W/L  Cat.  Code:  2.1.2,  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 
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Beatty,  J.  Pupillometrlc  measurement  of  cognitive  workload.  Proceedings  of 
the  12th  Annual  HASA-Univetsity  Conference  on  Manual  Control.  University  of 
Illinois ,  May,  1976,  135-143.  (NASA  TM  X-73  170). 

The  momentary  workload  that  is  Imposed  by  a  cognitive  task  upon  the  limited 
capacity  human  information-processing  system  appears  lo  be  accurately  reflected 
in  the  momentary  level  of  central  nervous  system  activation.  The  utility  of 
pupillometrlc  methods  of  workload  assessment  is  evaluated  and  several  lines 
of  experimental  evidence  relating  activation  and  cognitive  function  are  reviewed. 

W/L  Cat.  Code:  4.1.8 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Physiological  Pupillary  dia.  Experimental  Laboratory  Flight  simulator 

Flight  test 


Beatty,  J.  Pupillometrlc  methods  of  workload  evaluation:  present  status  and 
future  possibilities  In  B.  0.  Hartman  and  R.  E.  McKenzie  (Eds.)  Survey 
of  methods  to  assess  workload.  AGARD-AG-246 ,  August,  197S,  103-109. 


This  paper  discusses  the  use  of  purillometric  measures  in  the  evaluation  of  pilot 
workload.  First  the  innervation  of  the  pupil  with  respect  to  its  connections 

.  .  t  *  •  — a. s a-  4  ~~  4  o  Mn^om  mPfhnHft  for  OUDllloMt/iC 

wxtn  orainttLCiu  atuAvauiwu  o;otwuw  •  - - - - »  * 

measurement  are  then  described.  Next,  a  series  of  experiments  describing  pupillary 

response  in  a  variety  of  information-  processing  tasks  is  reviewed.  Finally 

some  possibilities  for  the  use  of  pupillometrlc  methods  in  the  measurement  of 

pilot  workload  are  discussed. 


W/L  Cat.  Code:  4.1.8 


Op.  Behav.  Code:  2. 

Physiological  Pupillary  dia.  Review  Laboratory  Flight  simulator 
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Ball,  F.  A.  Effect*  of  noise  and  heat  streea  on  primary  and  subsidiary  task 
performance.  Human  Factors,  1978,  20,  749-752. 

A  primary  pursuit  rotor  task  and  concurrent  subsidiary  number  processing  task  were 
performed  by  72  male  and  72  female  paid  volunteers  who  were  experiencing  ambient 
temperatures  of  22nC,  29°C,  or  35°C  and  noise  levels  of  either  55  dB(A)  or  95  dB(A). 
Performance  decrements  associated  with  high  noise  levels  and  high  ambient 
temperatures  were  additive  for  the  subsidiary  task.  Neither  noise  nor  heat  stress 
affected  perforoumce  on  the  primary  task.  Results  are  interpreted  in  terms  of 
an  overload  framework. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 

Primary  task  Single  measures 


Benel,  R.  A.,  Coins,  M.  G.  H. ,  and  Benel,  D.  C.  R.  Electrodarmal  lability  and 
individual  differences  in  simultaneous  monitoring  and  tracking.  Proceedings 
of  the  23rd  Annual  Meeting  of  the  Human  Factors  Society.  Boston,  Massachusetts, 
October  29  -  November  1,  1979,  518-522. 

Electrcdermal  (galvanic  ski  )  responses  conveniently  index  sympathetic  arousal. 
Individuals  with  high  levels  of  resting  electrodermal  activity  are  designated 
"labiles,"  while  those  with  low  levels,  'stabiles."  Labiles  appear  reslstanc  to 
performance  decrement  over  time  In  vigilance  tasks.  Thus,  increased  electrodermal 
responsivity  may  represent  enhanced  attentional  capacity  during  such  tasks.  The 
responses  of  10  lebiles  and  10  stabiles  were  collected  during  a  simple  reaction 
time  task  and  under  single  and  dual  task  monitoring  and  tracking  conditions. 

Subjects  monitored  an  automatic  tracking  task  for  dynamic  system  failures.  Tracking 
was  the  Critical  Task  with  a  subcritical  level  of  instability.  The  reaction 
time  data  paralleled  the  previously  reported  findings  of  Inferior  performance 
for  stabiles.  The  data  for  complex  single  and  dual  task  conditions  did  not  reveal 
a  similar  trend.  Generally,  stabiles  performed  better. 

W/L  Cat.  Code:  2.2.2,  3.1,  4.1.2 

Op  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Single  measures  Single  measures 

GSR 
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Benson,  A.  J.,  Huddleston,  J.  H.  F. ,  and  Rolfe,  J.  M.  A  psychophysiological 
study  oc  compensatory  tracking  on  a  digital  display.  Human  Factors,  1965, 
7.,  457-472. 

Comparable  performance  on  a  compensatory  tracking  task  was  achieved  with  a 
purely  digital  altimeter  display  and  with  a  combined  digital  and  scale-pointer 
display.  Performance  of  a  subsidiary,  light  responding,  task  was  degraded 
significantly  when  the  digital  task  was  employed.  In  the  presence  of  the 
subsidiary  task  a  larger  change  was  recorded  in  a  number  of  physiological 
variables  (heart  rate,  muscle  activity,  skin  resistance  and  respiration)  with 
the  digital  them  with  the  counter-pcint  display.  Thus,  both  performance  and 
physiological  measures  indicated  that  parity  of  performance  on  the  primary 
task  was  achieved  by  increased  "effort"  when  using  the  digital  display. 

W/I.  Cat.  Code:  2.2.1,  4.1.2,  4.1.4,  4.1.9,  4.1.10,  4.1.11 

Op.  Behav.  Code:  1.2,  2.,  4. 

Spare  id.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Physiological  Multiple 


Bergeron,  H.  P.  Pilot  response  in  combined  control  tasks.  Human  Factors,  1968, 

10,  277-262. 

Pilot  response  in  a  multi-task  simulation,  which  consisted  of  a  primary  control 
task  combined  with  one  or  two  secondary  or  side  control  tasks,  was  investigated. 

A  general  description  of  the  response  characteristics  of  each  of  these  tasks 
was  obtained  and  this  information  was  used  to  determine  the  workload  requirements 
of  the  tasks.  Two  different  control  tasks  were  used  as  the  primary  control  task, 
either  a  fixed-base  simulation  of  a  lunar  letdown  or  a  simplified  multi-loop 
tracking  task  which  wae  similar  to  the  end  of  the  lunar  letdown.  The  simplified 
tracking  task  was  in  lieu  of  the  more  complicated  lunar  letdown  because  it  could 
be  represented  and  reproduced  analytically.  The  secondary  or  side  tasks 
consisted  of  a  system-failures  task  and  motor  response  task.  The  system- 
failures  ..ask  was  incorporated  from  those  systems  present  in  a  vehicle  known 
as  the  Mercury  Procedures  Trainer.  The  motor  response  task  consisted  of  using 
n  pencil-like  device  to  make  impacts  on  two  separated,  restricted  columns. 

W/I,  Cat.  Code:  2.2.2,  3,1 

Op .  Behav .  Code :  1 . ,  2 . ,  4 . 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  measures 
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Bergstroem,  B.  and  Arnberg,  P.  Hetrt  rate  and  performance  in  manual  missile 
guidance.  Perceptual  and  Motor  Skills.  1971,  32 1  352-354. 

Earlier  stress  studies  under  laboratory  conditions  show  that  heart  rates  from 
100  to  110  bpm  are  associated  with  significant  decrements  in  missile-tracking 
performance.  Data  from  real  missile  tracking  by  eight  operators  with  no 
stress  deliberately  induced  indicate,  however,  that  performance  is  unaffected 
up  to  135  bpm,  and  only  moderately  affected  in  the  135-  to  170-bpm  region. 

The  disagreement  between  the  two  sets  of  results  highlights  the  difficulties 
in  generalizing  from  stress  experiments. 

W/L  Cat.  Code:  3.1,  4.1.30 

Op.  Behav.  Cede:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 

Physiological  Heart  rate.  Flight  test 

h .  r .  var . 


Beringer,  D.  B.  The  design  and  evaluation  of  complex  systems:  application  to 
a  man-machine  interface  for  aerial  navigation.  Proceedings  of  the  23rd 
Annual  Meeting  of  the  Human  Factors  Socelty,  Boston,  Massachusetts, 

October  29-November  1,  1979,  75-79. 

Systematic  and  economic  design  and  evaluation  strategies  were  applied  to  a  computer- 
generated  4-D  serial  navigation  system.  Experienced  instrument  pilots  received 
trailing  in  a  PLATO-based  digital  flight  simulator  using  either  a  keyboard  entry/ 
static  map,  keyboard  entry/dynamic  map,  or  touch  entry /dynamic  map  system. 

Digital  data  entry  training  time  was  comparable  for  all  three  systems  but  the 
touch-map  proved  superior  for  the  plotting  tasks,  greatly  reducing  training  and 
_usk  execution  times  while  virtually  eliminating  errors.  Subsequent  performance 
evaluation  showed  that  the  touch-map  reduced  flight  path  tracking  error,  increased 
processing  rates  on  a  digit-cancelling  secondary  task,  and  Increased  the  accuracy 
oi  manual  plotting  operations.  It  was  concluded  that  a  touch  entry  system  could 
significantly  reduce  cockpit  workload  across  a  wide  range  of  operational  environments. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4.1 

Spare,  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Frlmary  task  Single  measures  Flight  teat 
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Bermudez,  J.  M. ,  Harris,  D.  A.,  and  Schvank,  J.  C.  H.  Peripheral  vision  and 
tracking  performance  under  stress.  Proceedings  of  the  23rd  Annual  Meeting 
of  the  Hunan  Factors  Society.  Boston,  Massachusetts,  October  29-November  1, 
1979,  402-406. 


The  complexity  of  modem  aircraft  systems  places  substantial  information  processing 
loads  on  the  pilot.  Physiological  and  behavioral  evidence  for  two  human  visual 
systems  that  may  differ  in  susceptibility  to  psychological  stress  suggest**  the 
possibility  of  a  natural  stress  resistant  information  channel  that  could  be  used 
to  input  Information  during  stressful  flight  situations.  It  follows  thee  the 
extreme  peripheral  visual  fields  could  be  a  possible  location  for  adjunct  visual 
displays  that  serve  to  orient  expeditiously  the  pilot's  focal  vision  and 
attenticn.  Two  experiments  Involving  male  cadets  were  conducted.  The  data 
concern  the  effects  of  three  types  of  instrument  displays  u3ed  under  varying 
levels  of  stress  during  a  simulated  instrument  landing.  Stress  was  defined  as 
demand  for  primary  task-related  cognitive  activity.  A  modified  Sternberg  memory 
probe  technique  was  used  to  impose  these  demr.nds . 


W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Cede:  1.,  2.,  4. 


Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  measures 


Beyer,  R.  A  study  of  pilot's  workload  In  helicopter  operation  under  simulated 
IMC  employing  a  forward  looking  sensor.  Proce*.  dings  of  AGARB  Conference  on 
Studies  on  Pilot  Workload,  AGARD-CPP-217 ,  April,  1977,  36-1  -  B6-10. 

Various  measures  of  pilot  workload  are  known  which  are  presently  applied  to  human 
engineering  investigations.  It  is  difficult,  however,  to  find  a  measure  which 
has  proved  to  be  universally  applicable  and  adequately  validated.  Primary  task 
and  rating  measures  tailored  to  a  specific  application  may  be  less  flexible  but 
can  provide  relevant  and  sufficient  information  on  pilot  workload.  Thic  is 
demonstrated  by  referring  to  experiments  with  advanced  helicopter  displays 
which  were  tested  in  flight. 

W/L  Cat.  Code:  1.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Review  Flight  test  Flight  simulator 

Primary  task  Single  measure  Flight  test 


36 


5Y-27R-80 


Blsseret,  A.  Analysis  of  mental  processes  involved  in  sir  traffic  control. 
Ergonoalca.  1971,  14,  565-570. 

The  research  which  is  briefly  presented  here  has  been  carried  out,  during  the 
last  ten  years,  by  a  team  of  psychologists  at  the  Centre  d' Experimentation  de  la 
Navigation.  Aerienne,  whose  aim  is  the  automation  of  the  air  traffic  control 
system.  The  general  topic  refers  to  the  operator-computer's  interactions  in  a 
complex  system.  The  type  of  contribution  that  psychology  may  provide  is  shown 
by  indicating  the  three  interdependent  aspects  of  the  research:  1)  the  definition 
of  the  operator's  algorithms;  2)  the  analysis  of  his  "mental  representation";  and 
3)  the  study  of  the  effect  ci  the  workload  on  the  aental  processes.  The  general 
methodology  of  the  studies  of  mental  processes  is  presented;  and  an  experiment 
on  operative  memory  is  discussed. 

W/L  Cat.  Code:  2.1.1 

Gp.  Behav.  Code:  1.,  2.,  3.,  4> 

Spare  m.  capacity  Task  comp..  Construct  Field  Background 

time  assess.  Review 


Blaaw,  G.  J.  Godtholp,  J.  and  Korall,  J.  Driver's  lateral  control  strategy  as 
affected  by  task  demand?  and  driving  experience.  Society  of  Automotive 
Engineer?,  Paper  no.  770876,  1977. 

Driving  behavior  may  be  described  as  the  result  of  a  process  in  which  Performance 
is  optimized  to  meet  several  task  demands  at  the  same  time.  The  present  study 
investigated  how  different  task  demands  interact,  particularly  in  combination  with 
driving  experience,  the  latter  factor  being  indicative  for  driving  skill  develop¬ 
ment.  The  results  showed  that  driving  experience  as  a  main  experimental  factor 
interacted  significantly  with  task  demands  f or.  lateral  and  longitudinal  control. 
The  results  may  bo  important  for  the  discovery  of  characteristic  performance 
patterns  of  experienced  and  inexperienced  drivers  and  therefore  for  the 
development  of  driver  education  and  training  programs. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Control:  1.,  2.,  4. 

Primary  task  Single  measures  Experx.je.ntal  Field  Background 
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Blosccsynski,  R.  M,  and  Kozeranko,  O.P.  A  psychophysiologlcal  study  of  pilot 
behavior  in  conditions  of  combined  activity.  In  Optimisation  of  tha 
professional  activity  of  a  cosmonaut.  Moscow:  IzdatsPstvo  Kauke,  1977, 
160-169.  (In  Russian.) 


The  behavior  of  pilots  performing  two  different  kinds  of  tasks  simultaneously  is 
described.  One  teak  Involved  reception,  working,  and  transmission  of  oral  in¬ 
formation,  and  the  other  Involved  visual  tracking  and  psychomotor  compensation 
during  control  maneuvers  using  a  simulator.  Continuous  monitoring  of  psychomotor 
compensation  indices  (control  hand  movements)  and  of  physiological  functions 
(pulse,  arterial  pressures,  oral  temperature)  is  described.  It  vaa  found  that 
the  quality  of  compensatory  tracking  during  conditions  of  semantic  loading  depends 
on  the  initial  level  of  performance. 


W/L  Cat.  Code: 

Op.  behav.  Code: 
Spare  m.  capacity 
Primary  task 


2.2.1,  2.2.2,  3.1 
1.,  2.,  3.,  4 « 

Subsidiary  task  Experimental 
Single  measures 


Laboratory 


Flight  simulator 


H vx ,  A.  S.,  Stromme,  S.  B. ,  end  U.vsin,  H.  Additional  heart  rate-an  indicator 
of  TiS/chological  activation.  Aerospace  Medicine,  1974,  45,  1219-1222. 

Heart  rate  and  oxygon  consumption  of  helicopter  and  transport  aircraft  pilots 
were  measured.  During  flight  operations,  the  heart  rate  accelerated  without  a 
corresponding  increase  in  oxygen  coiistsnption.  This  heart  rate  increase  beyond 
that  expected  from  the  oxygen  uptake  is  therefore  used  as  an  indicator  of 
psychological  activation.  This  activation  did  not  depend  only  on  the  actual  task, 
but  also  on  the  experience  lev'!  of  the  pilot  himself.  The  levels  of  heart  rate 
(and  blood  pressure)  recorded  indicate  that  even  routine  missions  may  impose  a 
hazard  to  pliots  with  unmanlfested  or  latent  heart  failure.  This  obviously  calls 
for  frequent  workload-ECG  examinations  of  flying  personnel. 

W/L  Cat.  Code:  4.1,10 

Op.  ftehav.  Code:  1.,  2.,  3.,  4. 

Physiological  Heart  rate.  Experimental  Flight  test 

h.r.  var. 

Blood  pressure 


Flight  simulator 
Fligh  t  test 
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Boiler ^  1.  E.  and  Kruger,  W.  Investigation  of  a  control  davlca  with  force  Input 
and  dlsplac— i nt  feedback  In  ■  tearing- low-frequency  system.  Paper  presented 
at  the  19th  Anv^el  Conference  on  Manual  Control,  Wright  State  Dniveralty, 

Cay ton,  Ohio,  March  20-22,  1979.  (See  also  Zeltschrlft  fur  ATberlsvlssenschaft, 
1978,  32,  254-280,  In  German). 

In  manual  control  inf  oreatlon  about  the  vehicle  dynamic  behavior  can  be  advantageous 
for  the  operator.  Wi*h  low  frequency  systems  It  must  be  determined  whether  the 
advantage  of  kinesthetic  feedback  can  be  utilised  for  the  alow  movements,  b«c«uee 
technical  complexity  and  costs  Involved  are  at  a  relatively  high  level,  this  study 
compares  two  two-handed  yoke  controls  with  the  control  functions  of  (1)  displacement 
Input  and  (2)  force  Input  with  positional  feedback  aa  a  kinesthetic  display  of 
vehicle  response.  Eight  subjects  had  tc  reach  command  values  as  quickly  ee  possible 
controlling  the  low  frequency  system  output  variable  and  Its  derivative  (depth  and 
vertical  rate  of  a  simulated  submarine).  The  values  obtained  show  that  the 
technical  complexity  involved  in  a  control  with  force  input  and  positional  feed¬ 
back  is  not  worthwhile  for  the  siagle-axis  vehicle  dynastic  chosen. 


tf/L  Cat.  Code: 

2.1.1,  3.1 

Op.  Behav.  Code: 

1.,  2.,  4. 

Spare  m.  capacity 

Task  comp . ,  Experimental  Simulator 

time  assess. 

Flight  simulator 

Primary  task 

Primary  task 

Scrg,  Q.  Subjective  aspects  of  physical  and  mental  load.  Ergonomics ,  1978, 
21,  215-220. 

Methods  of  measuring  subjective  difficulty,  effort  and  other  aspects  of 
work-load  which  have  been  developed  by  the  author  and  his  colleagues  are 
described,  and  the  use  of  these  methods  as  means  of  distinguishing  between 
Individuals,  end  their  relationships  to  psychometric  measures,  are  discussed. 
Applications  are  noted  to  both  physical  and  mental  work. 

W/L  Cat.  Code:  1.1 

Op.  Pehav.  Code:  2.,  4. 

Opinion  Rating  scale  Review  None  Flight  simulator 

Flight  test 
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Bowser,  t>.  K.  Limiting  flight  control  systems.  In  AGARD  Conference  Proceedings 
No.  199.  Stall/Spin  Problems  of  Military  Aircraft.  (AGARD-CP-199)  June,  1976, 
11-1 -  11-12.  (AD  A029  071). 


Thin  paper  addresses  the  development  and  application  of  various  types  of 
automatic  flight  control  systems  for  hlgh-angle-of-attack  augmentation  and  Uniting. 
Considerations  included  are  improved  handling  qualities  for  maxlmun  tracking 
effectiveness,  reduced  pilot  workload,  control-configured  vehicles,  stall  inhibitors, 
and  departure  prevention  systems. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Opinion 
Primary  task 


1.1,  3.1 
1.,  2.,  A. 

Rating  scale  Experimental  Flight  teac  Flight  simulator 
Single  measures  Flight  test 


Boyce,  P.  R.  Sinus  arrhythmia  as  a  measure  of  mental  load.  Ergonomics,  1974, 

17,  177-183. 

This  experiment  examines  the  proposition  that  sinus  arrhythmia  Is  a  measure  of 
mental  load.  The  experiment  Involved  a  subtraction  task  in  which  the  physical 
and  mental  loads  could  he  varied  Independently.  The  results  indicate  that  sinus 
arrhythmia  does  decrease  with  an  increase  in  mental  load.  However,  heart  rat*1 
can  also  be  used  to  differentiate  between  the  mental  loads.  In  addition  it  was 
found  that  both  heart  rate  and  sinus  arrhythmia  Increased  for  an  increase  in 
physical  load.  This  Increase  in  sinus  arrhythmia  can  be  explained  by  the  static 
work  component  of  the  physical  load  and  the  scoring  system  used.  It  is  concluded 
that  changes  in  heart  rate  and  sinus  arrhythmia  are  bf'St  regarded  as  generalized 
responses  to  the  imposition  of  a  load. 

W/L  Cat.  Code:  1.1,  4.1.3,  4.1,10 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Laboratory  Flight  simulator 

Physiological  ERG 

Heart  rate, 
n.r.  var. 
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Boy lan,  R.  J.  A  review  of  crew  systems  analytic  method*.  Seattle*  Washington: 
Boeing  Aerospace  Company,  B180-1 7 525-1 »  January*  1974. 

The  purposes  of  crev  system  analytic  methods  are  to  provide  a  valid  methodology 
for  evaluating  design/ operational  requirements*  and  to  pinpoint  potential  trouble 
spots  early  in  the  design  cycle  before  the  system  reaches  the  hardware  stage. 

The  implementation  of  this  methodology  requires  a  firm  analytic  base  if  the 
results  are  to  have  a  bearing  on  operational  performance.  Zt  is  to  this  and 
that  the  present  review  was  undertaken*  attempting  to  compile,  in  summary 
fovm,  a  collection  of  effective,  easily  adaptible  analytic  methods  for  use 
in  man /machine  or  system  analyses.  The  second  purpose  of  the  document  is  to 
present  the  initial  development  work  on  s  general  mission  profile,  designed 
for  application  over  a  cross  section  of  civilian  and  military  aircraft.  Use 
of  the  profile  by  the  crew  systems  analyst  will  result  in  a  considerable 
saving  in  development  time,  as  task  and  functional  commonalities  are  maximised 
and  prevent  needless  duplication  of  effort.  In  using  the  general  mission 
profile,  the  analyst  can  plug  in  aircraft  specific  parameters  where  applicable, 
thus  approximating  the  function  of  contemporary  "user- interactive"  design  programs. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1. ,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp. ,  Review  None  Flight  simulator 

time  assess. 


Boylan,  R.  J.  Introduction  to  Boeing  operator  workload  and  workspace  evaluation 
iOuiis.  Seattle,  Washington:  Boeing  Aerospace  Company,  D180-17526-1, 
'm'.iary,  1°74. 

.wo  analytic  and  computer  aiding  programs  described  in  this  document  were 
a-*.,  loped  in  respire  to  a  growing  requirement  for  a  quick,  efficient  method 
for  designing  and  evaluating  the  man/machine  interface  in  contemporary 
aerospace  systems.  Nut  only  are  the  capabilities  of  tuch  programs  in  demand 
today  as  integral  tools  in  human  engineering  endeavors,  but  it  is  anticipated 
that  they  will  be  contractually  required  in  the  near  future.  In  order  to 
meet  this  challenge,  the  Boeing  Crew  Systems  Group  has  pursued  a  program 
aimed  at  the  development  and  refinement  of  computerised,  operator  evaluation 
programs.  The  two  programs  presented  in  this  document  constitute  examples 
of  these  effc-  ,  cc-  ng  workload  evaluation  of  cockpit  crews  (WECC)  based 
on  task  .mane  ..iiues,  and  workspace  accessibility  (TX-105)  based  c/a 

operator/control  distance  and  movement  sequences. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code’  1. ,  3.  ,  4. 

Spare  m.  capacity  Task  comp. ,  Construct  Laboratory  Flight  simulator 

tisae  assess. 
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Bradshaw,  J.  L.  Load  and  pupillary  changes  In  continuous  processing  tasks. 


1968,  59,  265-271. 


The  Interaction  of  rate  of  presentation?  and  nuaber  of  transforms  and  possible 
responses  was  examined  in  connection  with  the  effect  of  cognitive  load  upon 
pupillary  dilation.  The  task  involved  continuous  processing  of  auditorily 
praaanted  material.  The  two  criteria  of  task  difficulty  both  contributed  to 
raising  pupillary  disasters,  which  were  further  Increased  at  the  moment  of 
button— press  responding.  That  variations  In  level  arousal  were  Involved  was 
further  borne  out  by  the  tendency  for  certain  regular  changes  to  occur  in 
pupillary  dilation  in  the  course  of  the  process. log  tasks. 


W/L  Cat.  Code:  3.1,  4.1.8 

Op.  Behav.  Code:  2„ ,  3.,  4. 


Primary  task  Pupillery  dia.  Experimental  Laboratory  Flight  simulator 


Physiological  Single  measures 


Branscomb,  H.  H.  The  development  of  a  measure  for  task  induced  stress  in 

speech.  Mas _  ;r '  s  thesis,  Massachusetts  Institute  of  Technology,  Cambridge, 
Massachusetts,  February,  1975. 

In  an  experiment  involving  responses  to  Instructions  presented  on  a  video  terminal 
and  clicks  presented  in  a  pair  of  headphones,  subjects  were  tested  for  changes  in 
speech  patterns  as  a  function  of  task  load.  Opinion  ratings  and  task  scores 
were  also  obtained.  Results  indicate  that  there  is  a  systematic  and  reliable, 
but  not  very  accurate,  way  to  detect  the  Influence  of  task  difficulty  on  speech. 
Larger  sample  sizes  and  average  times  appear  to  be  required. 

W/L  Cat.  Code:  1.1,  3.1,  4.3 

Op.  Behav.  Code:  1.,  2.,  3. 

Opinion  Rating  scale  Experimental  Laboratory  Flight  simulator 

Primary  task  Single  measures 

Physiological  Speech  p&vt. 

anal. 
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Brecht,  M.  Cardiac  arrhythmia  and  secondary  tasks  a a  measures  of  mental  load. 
Master's  theaia,  California  State  University  at  Northrldge,  August,  1977. 

Flw  methods  of  scoring  cardiac  arrhythmia,  and  both  self-paced  and  adaptive 
versions  of  the  secondary- task  method  ware  competed  as  measures  of  o«entel  load. 
Bach  was  used  to  differentiate  among  easy,  medium,  and  difficult  versions  of  a 
mental  arithmetic  task.  In  this  standardised  task  situation  where  task  difficulty 
was  a  function  of  complexity  (load  stress),  only  the  secondary-task  measures 
reflected  changes  in  mental  loading  which  corresponded  to  the  Increasing 
difficulty  of  the  arithmetic  task.  The  self -pared  and  adaptive  secondary  taah 
verslona  were  quite  similar  as  Indices  of  the  mental  load  imposed.  Interference 
of  the  self-paced  secondary  task  with  the  primary  loading  task  was  not  a  problem. 
None  of  tho  cardiac  arrhythmia  measures  consistently  nor  accurately  quantified 
levels  of  task  difficulty. 


W/L  Cat.  Coda: 
Op.  Bahav.  Code: 


2.2.1,  2.2.4,  3.1,  4.1.10 
1.,  2.,  3. 


Spare  ®.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 


Primary  task 
Physiological 


Single  measures 
Heart  rate, 
h.r,  var. 


Brenner,  M. ,  Branscomb,  H.  H.,  and  Schwarts,  G.E.  Psychological  stress 

evaluator-two  tests  of  a  vocal  measure.  Psychophysiology,  1979,  I6r  351-356. 

The  Psychological  Stress  Evaluator  (PSE),  a  commercial  lie  dectector  employing 
voice  analysis,  was  tested  on  two  laboratory  tasks.  On  the  guilty  knowledge  task 
of  Lykken,  20  subjects  were  interrogated  on  personal  information  after  being 
offered  a  reward  to  fool  the  interrogator.  PSE  analysis  failed  to  identify  correct 
responses  beyond  chance  levels.  On  the  mental  arithmetic  task  of  Kahneman, 

Tursky,  Shapior,  and  Crider  and  Tursky,  Schwartz,  and  Crider,  16  subjects  performed 
arithmetic  problems  which  varied  in  difficulty  but  were  performed  under  identical 
pacing.  According  to  PSE  scoring,  stress  Increased  with  task  difficulty.  In 
addition,  the  PSE-measured  differences  occurred  with  high  consistency  across 
subjects.  Some  aspects  of  PSE  analysis  nay  be  valid  for  the  measurement  cf  stress, 
although  the  validity  of  the  analysis  for  practical  lie  detection  is  questionable. 


W/L  Cat,  Code:  3.1,  4.3 

Op.  Behav.  Code:  1.,  2.,  3. 


Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 

Physiological  Speech  patt. 

anal. 


SY-27R-80 


Brotmer,  M. ,  Branacomb,  3.  H. ,  and  Wright,  R.  A  computer  based  measure  of  vocal 
at tec 3.  (Unpublished  summary  report,  NASA  Kma  Research  Canter,  June,  1978- 
June,  1979.) 

The  purpose  of  the  program  la  to  develop  an  automated  measure  of  workload  baaed 
on  the  voice.  This  aaaa.ire  might  be  eaployed  in  aviation  eituations  without 
attaching  monitors  to  a  subject  of  interfering  with  cockpit  activity.  The  first 
year  project  consisted  of  three  parts:  A)  automation  of  the  available  procedures 
into  a  prototypa  uaaaure  ("automation'1) ,  B)  collection  of  high-fidelity  voice 
date  from  a  laboratory  workload  task  ("data  collaction") ,  and  C)  initial  testing 
of  the  prototype  measure  against  the  laboratory  results  "tearing") . 

W/L  Cat.  Code:  A, 3 

Op.  Behav.  Coda:  1.,  2.,  3, 

Physiological  Speech  patt.  Experimental  Laboratory  Background 

anal. 


Brlchcin,  M.  and  Hampejaova,  0.  Results  of  two  kinds  of  mental  load  measurements. 

Ceakoalovenskn  Paychologtfc,  1970,  14,  19-31.  (In  Czechoslovakian) . 

The  experimental  project  with  51  men  was  conceived  to  verify  whether  it  was 
possible  to  differentiate  in  secondary  task  conditions  the  effect  of  mental  load 
on  various  types  and  the  degree  of  difficulty.  The  model  of  the  Rental  activity 
consisted  of  gradual  deduction  of  number  7  for  a  6  minute  period  (the  7-  test)  and 
jf  searching  and  ranking  of  three-figure  numbers  in  a  specially  constructed 
number leal  square.  The  secondary  activity  consisted  of  a  periodic  reaction  to  an 
acoustic  signal  (voluntary  reaction:  the  flexion  and  extension  of  the  right 
forearm) .  The  course  of  each  reaction  was  measured  by  24  different  parameters 
(position,  time,  speed  and  force) .  The  personality  traits  of  the  Investigated 
men  were  tested  by  Cattell's  16  P.F.Q.  Results  of  the  statistical  analyses  ere 
described  in  detail. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


2.2.1,  3.1 
1.,  2.,  4. 

Subsidiary  task  Experimental  Laboratory 
Single  measures 


Flight  simulator 


SY-27R-B0 


Brief son,  C.  A .  Pilot  landing  performance  unde*  high  workload  conditions.1 
La  Jolla,  California:  Dunlap  and  Associates,  Contract  HC0014-73-C-0053, 
April,  1974.  (AD/A  001  802). 

A  longitudinal  study  of  pilot  carrier  landing  performance  was  conducted  to 
describe  rha  Influence  of  prolonged  operations  on  pilot  performance.  A  landing 
performance  criterion  previously  validated  in  a  fleet  environment  was  used  to 
measure  and  compare  pilot  and  squadron  performance  variations  over  time,  three 
level*  of  cumulative  workload  were  defined  to  evaluate  concomitant  changes  in 
performance  associated  with  each  workload.  Pilot  landing  performance  improved 
over  time  with  more  improvement  found  in  night  performance  than  day.  The 
Influence  of  practice  on  carrier  landings  is  discussed  in  relation  to  high 
cumulative  workload.  Tha  performance  criterion  was  used  to  Identify  potential 
night  pilots  on  tha  basis  of  landing  proficiency.  High  and  low  proficiency 
pilots  also  were  identified  and  diagnostic  training  Information  provided.  A 
statistically  significant  Increase  ir.  night  landing  performance  during  high 
cumulative  workload  may  be  due  to  practice  effects  as  well  as  workload. 

W/L  Cat.  Code:  2.1.1,  3.1 

Op.  Behav.  Code:  1. ,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp. ,  Experimental  Flight  test  Flight  simulator 

time  *>.38688. 

Primary  task  Single  measure  Flight  test 


Brictson.  C.  A-  Pilot  landing  performance  under  high  workload  conditions. 

Proceedings  of  the  AGARS  Conference  on  Simulation  end  Study  of  High  Workload 
Operations ,  AGARD-CP-146 ,  April,  1974,  A7-1  -  A7-10. 

A  longitudinal  study  of  pilot  carrier  landing  performance  was  conducted  to 
describe  the  influence  of  prolonged  operations  on  pilot  performance.  A  landing 
performance  criterion  previously  validated  in  a  fleet  environment  was  used  to 
measure  and  compare  pilot  end  squadron  performance  variations  over  Lime.  Three 
levels  of  cumulative  workload  were  defined  to  evaluate  concomitant  changes  in 
performance  associated  with  each  workload.  Pilot  landing  performance  Improved 
over  time  with  more  improvement  found  in  night  performance  than  day.  The 
influence  of  practice  on  carrier  landings  is  discussed  in  relation  to  high 
cumulative  workload.  The  performance  criterion  was  usad  to  Identify  potential 
night  pilots  on  the  basis  of  landing  proficiency.  High  and  low  proficiency 
pilots  also  were  identified  and  diagnostic  training  information  provided.  A 
statistically  significant  increase  in  night  landing  performance  during  high 
cumulative  workload  may  be  due  to  practice  effects  as  well  as  workload. 

W/L  Cat,  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measure  Experimental  Flight  test  Flight  simulator 


Flight  teat 


SY-27R-B0 


Brlctson,  C.  A.  Methods  to  assess  pilot  workload  and  other  temporal  indicator* 
c t  pilot  performance  effectiveness.  Proceeding*  of  AGARD  Conference  or.  Studies 
on  Pilot  WorkJoad.  AGARD-CPP-217,  April,  1977.B9-1  -  M'TT 

A  systematic  approach  to  define,  measure  and  describe  how  certain  pilot-related 
variables  influence  carrier  landing  performance  during  sustained  operations  is 
briefly  outlined.  Previous  exploratory  research  on  the  interrelations  between 
psychophyalological  variables,  pilot  experience  and  performance  is  daacrlbed. 

Pilot  work  activity,  mood  and  sleep  are  identified  as  indicators  of  a  pilot's 
temporal  statu  of  readiness.  A  field  study  design  and  techniques  to  measure  and 
describe  temporal  readiness  during  prolonged  flight  operations  are  provided  to 
demonstrate  the  methodology  in  an  operational  environment.  Potential  applications 
of  the  research  are  discussed  along  with  the  future  role  of  temporal,  psychological 
and  other  moderator  variables  in  estimating  pilot  flight  status. 

W/L  Cat.  Code:  1.1,  1.2,  3.2,  4.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiple  Construct  Flight  test  Flight  simulator 

Primary  task  Flight  test 

Physiological 


Brlctson,  C.  A.  and  Clavarelll,  A.  P.  Aircrew  performance  research  opportunities 
using  che  air  combat  maneuvering  range  (ACMR) .  In  B.  0.  Hartman  and  R.E. 
McKlnzle  (Eds.)  Survey  of  methods  to  assess  workload.  AGARD- AG-246,  August, 

1070  111-113 


Three  years  of  aircrew  performance  measurement  related  to  air  combat  effectiveness 
using  the  Navy's  Air  Combat  Maneuvering  Range  (ACMR)  are  presented.  Performance 
assessment  methods  used  to  evaluate  pilot  proficiency  are  described.  The  aircrew 
assessment  methods  have  been  used  to  identify  squadron  performance  differences, 
evaluate  competitive  exercises,  and  provide  diagnostic  training  feedback  to 
operational  users.  The  availability  of  objective  performance  criteria  promise 
to  be  of  substantial  benefit  to  both  the  operational  uter  and  the  research 
community  in  such  arias  as  pilot  selection  and  training,  fleet  combat  readiness, 
and  pilot  workload  end  stress. 

W/L  Cat.  Code:  3.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Mult  measures  Review  Flight  test  Flight  simulat  or 

Flight  test 


46 


SY-27R-B0 


Brictson,  C.  A.,  McHugh*  W.  And  Naitoh,  P.  Prediction  of  pilot  performance: 
Biochemical  And  sleep-mood  correlate*  under  high  workload  condition*. 
Proceeding*  of  the  AGAKD  Conference  on  Simulation  and  Study  of  High  Worklo ad 
Operatione,  AGARD  CP- 146,  April,  1974,  A13-1  -  A13-10. 

A  preliminary  longitudinal  study  of  the  factors  affecting  the  carrier  landing 
performance  of  naval  aviators  under  high  workload  conditions  has  bean  carried 
out.  Using  stepwise  multiple  regrosslon  techniques,  a  substantial  portion  of 
the  variability  in  landing  performance  could  be  accounted  for  by  six  factors 
under  zero  cumulative  workload  conditions  and  by  seven  factors  under  moderate 
cumulative  workload  conditions.  High  cumulative  workload  conditions  sharply 
reduced  predictive  ability.  Although  specific  aircraft  experience  and  totol 
flight  experience  were  important  predictors  of  average  landing  performance, 
blood  biochemical  levels  and  emotional  states  had  significant  predictive  ability. 
Sleep  patterns  relate  strongly  to  performance.  The  factors  that  determine  landing 
performance  change  as  cumulative  workload  Increases.  Suggestions  for  further 
research  in  this  area  axe  discussed. 

W/L  Cat.  Code:  4.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Mult,  measures  Experimental  Flight  test  Flight  simulator 


Brigham,  F.  R.  COPTEC-A  controller  overload  prediction  technique. 
Loughborough,  England:  Human  Sciences  and  Advanced  Technology 
Research  Group,  Department  of  Human  Sciences,  University  of  Technology, 
HUSAT  Memo.  No.  67,  February,  J974. 

During  the  course  of  a  number  of  field  studies  of  control  tasks,  it  became 
clear  that  controller  overload  was  an  important  probleo .  One  of  the  reasons 
for  controller  overload  was  the  occurrence  of  simultaneous  high  priority 
demands.  Since  the  human  operator  tends  to  behave  as  a  single  channel 
information  processor  in  situations  of  this  type,  he  can  only  satisfactorily 
attend  to  one  demand  at  a  time.  Given  the  existence  and  the  importance  of 
the  problem,  it  would  be  useful  if  this  type  of  overload  could  be  predicted 
in  advance,  so  that  due  account  could  be  taken  during  task  design  and  manpower 
planning.  This  is  the  purpose  of  the  technique  described  in  this  report. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  Field  Flight  simulator 


SY-27R-80 


Broadbent,  D.E.  and  Haron,  A,  Bf fact*  of  a  subsidiary  caak  on  performance 
involving  immediate  memory  by  younger  and  older  man.  British  Journal  of 
Psychology,  3962,  53,  189-196. 

Moat  situation*  devised  by  psychologists  .xwaina  either  reaction  to  stgnala 
without  memory,  or  memory  without  raaction.  A  task  has  bean  devised  In  which  both 
functions  ara  involved.  Sats  of  random  numbers  are  observed  through  a  small  slot 
allowing  only  a  faw  number*  at  a  time  to  bo  visible.  The  subject  has  to  cross  out 
particular  digits,  and  has  to  remember  which  digit  he  la  staking  nt  any  particular 
instant.  This  type  of  task  is  coapsrad  with  a  more  conventional  number  crossing 
task,  in  the  present  experiment  It  was  found  chat  the  tasks  involving  memory 
era  vary  vulnerable  to  distraction.  The  older  aubjects  differed  greatly  among 
themselves,  soma  being  seriously  Inferior  in  performance  to  younger  subjects; 
no  auch  difference  In  vnriancs  appears  in  the  similar  task  without  memory  load. 
Whan  a  distracting  teak  la  presented  togothor  with  a  main  task  involving  memory, 
older  subjects  do  very  badly  At  one  or  the  other,  whereas  young  subjects  do 
reasonably  ct  both. 

W/L  Cat,  Code:  2.2.1,  3.1 

Op.  Behav.  Cod*:  1.,  2,,  4. 

Spiture  m.  capacity  Subsidiary  tnsk  ilxper imant al  Laboratory  Background 

Primary  task  Single  measures 


vlromberger,  R.  A.  LAMPS  simulations;  VI  Pilot  performance  in  the  1  AMPS 
simulator.  Warminster,  Pennsylvania:  Novel  Air  Development  Centex, 
NADC-/6191-40,  October,  1976. 

Thlu  report  ewnminot  th*  pilot’s  ability  to  follow  a  predetsmlned  flight  path 
under  five  instrument  panel  configuration#,  Ihratt  variables;  (.1/  presence  or 
absence  of  a  pilot's  view  of  the  IAMPS  ASW  tactics,  (2)  ground  vs.  aircraft 
eteblHsed  format  for  taction,  (3)  traditional  flight  Instruments  vs,  «n 
elect  conic  presentation  o?  flight  information  war*  tested.  It  was  conduced 
objective  measures  uf  performance  (deviations  from  prude tc-uinad  flight  paths) 
revealed  uo  practical  differenvea  in  performance.  Subjective  opinion  suggested 
*  preference  for  traditional  instrumentation  and  a  ground  stabilised  view,  if  a 
view  of  tactics  is  included. 

W/L  Cat.  Codes  1.2,  J.l 

Op.  Behav.  Code:  1,,  2.,  4. 

Opinion  Questionnaire  Experimental  Flight  simulator  Flight  simulator 

Primary  task  Single  measure  Flight  test 


48 


SY-27R-80 


Brown,  E.  L. ,  Stone,  G.  end  Pearce,  W.  E.  Improving  cockpits  through  flignt 
crew  workload  measurement.  Paper  presented  at  the  2nd  Advanced  Aircrew 
Display  Symposium,  U.S.  Naval  Air  Test  Center,  Patuxent  River,  Maryland, 

April  23-25,  1975.  (Douglas  Paper  6355). 

This  project  is  directed  toward  developing  the  capability  to  measure  objectively 
the  flight  crew  workload  with  sufficient  sensitivity  to  differentiate  between 
alternative  crew  station  layouts,  controls,  and  displays.  The  computerised 
technique  concentrates  on  design  factors  under  the  control  of  crew  station 
designers  and  provides  for  quick  and  low-cost  iteration  of  alternatives.  The 
program  provides  workload  as  related  to  specific  equipments  and  systems, 
permitting  special  attention  to  be  given  to  high  workload  items  during  the 
early  development  of  concepts  and  hardware  befoxe  simulation  is  available. 

The  technique  and  program  is  also  applicable  to  integrated  displays,  including 
those  where  programming  to  meet  information  requirements  is  an  element. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp..  Construct  Laboratory  Flight  simulator 

time  assess. 


Brown,  1.  D.  Measuring  the  spare  mental  capacity  of  car  drivers  by  a  subsidiary 
auditory  task.  Ergonomics ,  1962,  5^,  247-250. 


We  have  attempted  to  measure  spare  capacity  by  giving  the  driver  a  subsidiary 
auditory  cask  to  perform  when  he  could.  Our  first  experiment  was  devoted  to 
finding  out  whether  the  method  was  sufficiently  sensitive,  and  safe,  for  field 
studies  of  driving.  As  a  report  of  this  experiment  has  already  been  publiched 
(Brown  and  Poulton  1961),  and  the  experiment  la  being  demonstrated  at  this 
congress,  1  need  not  go  into  details.  We  simply  gave  drivers  an  auditory  task 
to  perform  in  two  different  levels  of  traffic.  In  a  second  experiment  the  method 
is  being  used  in  a  study  of  fatigue.  This  experiment  also  has  a  second  objective, 
which  is  to  compare  two  quite  different  types  of  subsidiary  auditory  task.  We 
conclude  that  relatively  small  Jnanges  in  a  uriver's  spare  capacity  can  be 
detected  by  scoring  hie  performance  on  a  subsidiary  task  which  has  adverse 
effe.ct  upon  driving.  We  can  measure  the  clump, e  in  his  level  of  concentration 
which  results  from  a  change  in  the  level  of  traffic ,  and  we  think  that  we.  can 
measure  the  effect  of  fatigue  vipoo  f.pare  capacity,  although  better  controlled 
experiments  are  needed  to  answer  the  real  questions  here. 


W/L  Cat.  Code: 

Op.  Bjhav.  Code: 

Spare  m.  capacity 


2.2.1 

1.  ,  2.  ,  4.. 

bubeidinry  t^sk 


Experimental  Field 


Flight  simulator 
Flight  test 
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Brown,  I.  D.  A  comparison  of  two  subsidiary  tasks  vised  to  measure  fatigue 
in  car  drivers.  Ergonomics ,  1965,  6,  467-473. 

Car  driving  has  been  studied  by  combining  it  with  a  subsidiary  task,  performance 
on  which  la  negatively  correlated  with  the  perceptual  load  impend  by  changing 
conditions  of  traffic.  The  present  experiment  compares  a  subsidiary  task  which 
required  almost  continuous  attention  to  an  auditory  display,  and  which  involved 
memory  spans  of  only  3  sec,  with  an  alternative  task  which  did  oc<;  require 
continucus  attention,  but  which  involved  memory  spans  of  up  to  sec.  The 
former  was  found  to  have  some  advantages.  This  comparison  was  combined  with 
a  study  of  men  engaged  in  8-hour  spells  of  car  driving.  Some  expiations 
are  offered  for  the  finding  that  performance  on  the  subsidiary  tasks  was  better 
at  the  end  of  the  work-spell  than  at  the  beginning.  , 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Field  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Brown,  T. .  D.  Subjective  and  objective  comparisons  of  successful  and  unsuccessful 
trainee  drivers.  Ergonomics ,  1966,  £,  49-56. 

Twenty-two  men  rare  tested  at  weekly  intervals  during  their  5  weeks’  course  c*. 
instruction  in  bus-driving.  The  use  of  the  vehicle's  controls  ar.d  time  taken  ove. 
a  standard  circuit  in  traffic  were*  recorded  lit  «acfc  test,  and  the  trainees' 
reserve  capacity  was  measured  by  scoring  theii  performance  on  a  subsidiary 
auditory  task.  Details  wer-i  availab’t  of  previous  driving  experience  with  other 
vehicles  and  the  trainees  vere  also  subjectively  assessed  at  weekly  progress 
chocks  given  by  experienced  examiners.  Th:»  object  was  to  compare  scores 
obtained  by  trainees  who  passed  tne  independent  driving  test  for  Public  Service 
Vehicles,  giver.  at  the.  end  of  their  course,  with  the  scores  of  those  who  failed. 
Socceus  on  the  P.S.V.  test  was  significantly  related  to  previous  experience  of  ^ 
any  kind  (p«^;.004),  and  to  the  result  of  the  progress  check  given  after  14  days 
training  <t>"*0.0002).  The  reserve  capacity  of  the  successful  ^roup  was  significantly 
greater  than  that  of  the  unsuccessful,  at  the  first  tost  given  on  the  7th  day 
(p<0.025) .  At  v.c  stage  during  training  could  the  two  groups  be  discriminated  on 
the  abjective  measurements  made  directly  on  driving  performance.  The  relative 
merits  of  these  methods  of  assessing  delving  potential  are  briefly  discussed, 
with  a  view  to  the  design  of  simple  selection  tests  for  professional  drivers. 

W/I.  Cat.  Coda:  2.2.1,  3.1 

Op.  Behav.  Code:  1. ,  2..  4. 

(ipare  it.  capacity  Subsidiary  task  Expariioental  Field  Flight  simulator 
Frimary  task  Single  meat  vires  Flignt  test 
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Brown,  I.  D.  Dual  tack  methods  of  aosessing  work-load.  Ergonomics »  1978, 

21,  221-224. 

Various  applications  and  dasign  factors  of  dual  task  situations  are  critically 
surveyed.  It  is  concluded  that  many  applications  cake  questionable  assumptions 
ar.d  that  many  frequently  used  features  of  design  are  unsatisfactory.  However, 
tha  technique  appears  to  be  valid  and  useful  for  the  study  of  individual 
differences  in  processing  resources,  when  the  additional  task  is  secondary, 
presents  discrete  stimuli  which  impose  constant  load,  if?  carried  out  a*,  a 
forced  pace  and  competes  with  the  primary  task  for  processing  resources  only. 

W/L  Cat.  Code:  2.2 

Op.  Behav.  Code:  1. ,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  3one  Flight  simulator 

Flight  t^st 


Brown,  I.  D.  and  Poulton,  E.  C.  Measuring  the  space  mental  capacity  of  car 
drivers  by  a  subsidiary  task.  Ergonomics ,  1?61 ,  .4,  3 5- Mi. 

It  is  impossible  to  determine  the  degree  to  which  a  driver  is  absc.rD&d  in 
his  driving  by  measuring  his  overt  responses  directly.  However,  relatively 
small  changes  in  his  spare  ‘mental  capacity"  can  be  detected  by  scoring 
performance  on  t»  subsidiary  t tsk,  which  her.  nc  adverse  effect  upon  driving. 
This  technique  is  sufficiently  sensitive  to  reveal  the  higher  level  ox 
concentration  required  in  a  ohoppin0  ar^a  ae  compared  with  that  required  in 
a  t evidential  arm. 

W/l  Cat.  C'ode:  2.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Fit-lv  Flig'C  six*  ilstor 


Flight  test 
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Buckley,  E.  P . ,  O'  Corner,  H.  F.  Individual  and  system  performance  Indices  for 
the  air  traffic  control  aytttom.  In  B.  0.  Hartman  and  1.  E.  McKenzie  (Eds.) 
survey  of  Methods  to  Assess  Workload.  AGARD- AG-246,  August,  1979,  135-136. 

This  study  examined  the  relationships  between  field  air  traffic  controller 
Performance  indices  and  system  performance  measures.  The  study  encompassed  per¬ 
formance:  criteria  developed  within  two  distinct  environments,  the  controller's 
horse  facility  vrhere  he  controlled  live  traffic,  and  a  specially  designed 
microsystem  or  "one-man  ATC  system"  with  simulated  traffic.  This  microsystem 
simulation  was  done  at  the  National  Aviation  Facilities  Experimental  Center. 

The,  experiment  rep re rent ad  a  comparative  examination  of  several  quantitative  measures 
of  oyotem  functioning  derived  from  air  traffic  control  simulation  and  an 
investigation  of  these  nen&ures  as  indices  for  the  objective  evaluation  of  the 
individual  air  traffic  controller. 

W/I,  Cat.  Coder  3.1,  A.  1.2,  4.1.10 

Op.  Behav.  Codes  1.,  2.,  3.,  4. 

Single  treasures  Experimental  Simulation  flight  simulator 
GSR  Flight  test 

Heart  rate, 
h.r.  var. 


Burke,  J .  E.  Use  of  Eye  Mark/Sony  VtdeocorJer  System  and  related  data 
reduction  Dallas  Trams:  !.TV  Aerospace,  Vought  Systems  Division, 

VSF  Report  2-57113/ 3R-3107,  Atgust,  1973. 

Recent  VSE  exoa. ien :e  with  in-f light  recording  of  pilot  viewing  requirements 
in  U.  S.  Army  helitof :era  has  demonstrated  the  feasibility  of  the  equipment 
used  (ifld  She  related  ictf  reduction  procedures.  This  document  summarizes  the 
mcvlndge  pained.  It  1=*  a  compilation  o'  selected  portions  of  the  draft 
jeraicn  of  7SD  Report  2-57110/11-3107,  Study  to  Analytically  Derive  External 
Vision  Requirement*  for  0,  S.  Army  Helicopters.  This  effort  was  conducted 
for  the  0.  S.  Army  Aviation  Systems  Commanc  under  contract  No.  DAAJ01-72-C-0887. 

W/L  Cat  Code-  3.1,  4.1."» 

Op.  Behav,  Code:  1.,  2.,  4. 

Primary  task  Single  keasures  Expe*'  imental  Flight  test  Flight  simulator 
Physiological  Eye  movement 


Primary  task 
Physiologic,  tl 


Flight  test 
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Burk*,  J.  B.  In  flight  acquisition  of  task  sequences  and  tank  tines'.  Paper 
presented  at  the  nesting  of  the  Aerospace  Medical  Association,  T*as  l\*gaa, 
Nevada,  May,  1977. 

The  human  engineering  of  pilot  provisions  in  current  aircraft  is  based  upcn 
analytical  definition  of  pilot  contribution  to  system  operation.  A  technique 
is  proposed  to  gather  empirical  data  on  pilot  operations,  so  that  follow-on 
analyses,  simulations,  and  hardware  developments  will  have  a  solid  operational 
’rion.  Vought  has  demonstrated  key  features  of  the  proposed  system, 

-g  existing  equipment,  in  a  recent  helicopter  vision  study  for  the  U.  S. 
cay  Aviation  Systems  Command  under  contract  No.  DAAJ01-72-C-0887.  This  study 
used  a  single  point  MAC  Eye  Mark  recorder  and  Sony  vldeo/audio  taping  system. 
The  helmet  mounted  Eye  Mark  recorder  provides  pilot  field-of-view,  which  also 
picks  up  hand  notion,  and  point  of  visual  reference.  This  visual/audio  data 
needs  to  be  supplemented,  complemented r  or  verified  with  other  system  measures 
which  are  common  to  the  instrumentation  of  all  new  military  aircraft.  These 
include:  stick/ rudder/throttle  positions,  rates  of  deflection,  and  forces; 
aircraft  flight  profile;  aircraft  subsystems  modlng  and  performance. 

W/L  Cat.  Code:  3.1,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  meaaures  Experimental  Flight  simulator  Flight  simulator 

Physiological  Eye  movement  Flight  test  Flight  test 


Burke,  M.  W.  An  investigation  of  visual/ tactual  multi-modal  information  processing 
using  dual  cross-adaptive  critical  tracking  tasks.  Columbus,  Ohio:  The 
Ohio  State  University  Aviation  Psychology  Laboratory,  Technical  Report  No.  2, 
March,  1979. 


This  investigation  compared  performance  on  a  secondary  subcritical  tracking  task 
using  a  visual  display  when  the  pvimary  subcritical  task  either  also  used  a  visual 
display  or  instead  used  a  velocity  -id  kinesthetic-tactile  (KT)  display.  The 
primary  and  secondary  tasks  were  cross-adap tively  coupled.  Four  visual  display 
conditions  were  examined  to  isolate  the  contributions  of  peripheral  scanning  and 
aiding  factors  to  cross-modal  workload  relief.  After  four  days  of  dual-task 
tracking,  the  subjects  using  a  KT  primary  display  had  significantly  higher 
secondary  task  workload  capability  with  Integrated  and  separated  visual  displays 
indicated  that  the  superiority  of  the  KT  display  was  not  simply  cue  to  tha 
elimination  of  scanning. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 

Spare  m.  capacity 

Primary  task 


2.2.5,  3.1 
1.,  2.,  4.1 

Subsidiary  task 

Single  measures 


Experimental 


Laboratory 


Background 
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Buttcrbcugh,  L.  C.  Crew  workload- technology  review  and  problem,  assessment. 

Wright-Pat tersou  Mr  Force  Base,  Ohio:  Flight  Dynamics  Laboratory ,  Technical 
Memorandum,  AFFDL--TM-78-74-FSR,  January,  1978. 

The  applications  and  resulting  technical  requirements  of  nilot/crev  workload 
measurement /prediction  methods  are  reviewed  and  dlscus^ea.  In  addition e  existing 
pilot/crew  workload  measurement /predict ion  technology  la  Identified  and  reviewed. 

An  assessment  of  the  adequacy  of  thf se  techniques  relative  to  the  identified 
requirerents  la  performed.  Generally,  the  state  of  workload  measurement/prediction 
technology  la  not  suf f tclently  developed  for  measuring  y  : dieting  total  mission- 
derived  workload,  but  is  .sufficient  for  part- task  applies;.!. ns. 


H/L  Cat.  Code: 

1.  »  2.,  i.  , 

4. 

Op.  Behav.  Code: 

1.,  2. ,  3,, 

4. 

Opinion 

Spare  m.  capacity 
Primary  task 
Physiological 

Multiple 

Review 

None 

Flight  simulator 
Flight  teat 

Cannings,  R.  Speecn  patterns  and  aircrew  workload.  In  B.O.  Hartman  and  R.E. 
McKern-. ie  (Eds.)  Survey  of  trethods  to  assess  workload.  aGARD-AG-246 , 
August,  1979,  115-127, 


The  uae  of  speech  patterns  tr.  the  analysis  of  workload  is  examined.  The  rather 
sparse  amount  of  research  effort  expended  in  this  field  is  reviewed  in  terms  of 
a  simple  model  of  speech  production  and  the  applications  of  current  analysis 
techniques  are  considered.  There  is  intuitive  evidence  to  suggest  thac  high  work¬ 
load  or  stress  may  change  the  fundamental  characteristics  of  speech.  Although  the 
voice  may  not  exhibit  obvious  varieties*  during  normal  flight  profiles,  a  search 
for  change  in  speech  may  prove  to  be  a  worthwhile  approach  in  the  investigation 
of  workload  In  air  operations.  However,  central  to  the  possible  use  of  speech 
patterns  is  the  requirement  to  reduce  complex  speech  data  to  parameter  sets  of  a 
manageable  size,  and  to  relate  these  sets  to  the  psychological  and  physiological 
state  of  the  pilot.  Optimum  choice  of  parametur  sets  constitutes  a  difficult 
task,  but  there  is  an  ever  increasing  literature  concerned  with  speech  processing 
which  provides  many  techniques  of  analysis. 


W/L  Cat.  Code:  4.3 

Op,  3ehav.  Code:  1.,  2.,  3.,  4. 


Physiological 


Speech  patt. 
anal. 


Review 

Construct 


Laboratory  Flight  simulator 
Flight  test 
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Cannings ,  R.,  Borland,  Ri  G. ,  Hill,  L.  !.  and  Hlcholson,  A.  N.  Pitch  and  , 
formant  analysis  of  tha  votes  in  tha  investigation  of  pilot  workload. 

Proceedings  of  the  AGABD  Conference  on  Methods  to  Assess  Workload.,  AGARD-CPP-216, 
April,  13777  A5-1  -  A5-10. 

Computer  techniques  are  described  which  extract  parameters  from  the  speech 
waveform  which  are  amenable  to  statistical  analysis  and  can  be  compared  to  the 
structure  of  the  pilots  speech  waveform  at  different  points  in  the  flight 
profile.  Physiological  data  and  subjective*  assessment  may  be  used  to  indicate 
the  workload  of  the  flight  p~  'f  >  *  that  the  voice  parameters  can  be  correlated 
with  known  workload  levels,  in  rw.  present  study  the  call  sign  of  British 
Airways  "Speedbird"  was  analya.  '  *ve^h  in  terms  of  pitch  and  format  information. 

It  was  concluded  from  p’^imir.av  examination  of  in-flight  recordings  that  this 
technique  is  useful  for  :lasslfyir,g  specific  phonemes  and  is  effective  despite 
the  noise  corruption  of  the  raw  data. 

W/L  Cat.  Cede:  4.3 

Op.  Behav.  Code:  1.,  2.,  4. 


Physiological  Speech  patt. 

anal. 


Experimental  Laboratory  Flight  simulator 

Flight  test 


Cantrell,  G ,K.  and  Hartman.  B.O.  Application  of  time  and  workload  analysis 
technics  to  transport  flyers.  Brooks  AFB,  Texas:  USAF  School  of  Aviation 
Medicine,  Technical  Report  SAM-TR-67-71,  August,  1967. 

Two  groups  of  Military  Airlift  Command  aircrewmen  reported  on  their  activities 
In  half-hour  blocks  around  the  clock — one  group  for  15  consecutive  daysc  che 
other  for  20  consecutive  days-=-to  provide  data  on  the  typical  transport  flyer's 
workload.  Mean  times  on  approximately  50  different  activities  are  presented. 

Crew  availability,  level  of  job-satisfaction,  and  fatigue  are  analysed.  It 
is  concluded  that:  crew  ax’ailabilitv  is  nearly  100%  and  does  not  limit 
airframe  utilization;  certain  factors  are  sources  of  continuing  frustration 
to  aircrewmen;  persistent  complaints  of  fatigue  appear  to  arise  from  frustration 
rather  than  overwork;  any  improvements  resulting  in  s  decrease  in  aircrew 
frustration  should  improve  aircrew  morale  and  level  of  job-satisfaction;  changes 
designed  to  increase  airframe  utilization  rates  may  increase  the  level  of  aircrew 
frustration;  and  consideration  should  be  given  to  training  as  aircrewmen  only 
those  individuals  free  from  excessive  sensitivity  to  frustrating  conditions. 

W/I.  Cat.  Code:  1.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Questionnaire  Experimental  Field  Flight  simulator 

Flight  test 


L“al  i±J‘« *T*-»  ' '  >•'  r  -*  tjr 
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Capita,  R.  D.  and  Jones,  K.  W.  Effects  of  work  load,  role  aablgulty,  and  type 
a  personality  on  anxiety,  depression ,  and  heart  rate.  Journal  of  Applied 
Psychology.  1975,  60,  713-719. 


Type  A  personality  (hard  driving,  persistent,  involved  in  work)  was  studied  as 
a  conditioner  of  the  effects  of  quantitative  workload  end  role  ambiguity  (grasses) 
on  anxiety,  depression,  resentment,  and  heart  rate  (strains)  among  73  male  users 
of  a  university  computer  system  that  was  approaching  an  imninent  23-day  shutdown. 
Bach  respondent  was  his  own  control.  Stress,  personality,  and  psychological 
strain  were  assessed  by  questionnaire,  and  heart  rate  was  measured.  Change  scores 
were  then  analysed.  Stole  ambiguity  was  positively  associated  with  anxiety, 
depression,  and  resentment;  subjective  workload,  was  positively  associated  only 
with  anxiety.  Anxiety  was  positively  related  to  heart  rate.  The  relationship 
between  workload  and  anxiety  was  greatest  for  Type  A  persons,  and  a  similar,  but 
nonsignificant  trend  Appeared  for  the  effects  of  anxiety  on  heart  rate.  Response 
and  respondent  specificity  are  discussed. 


W/L  Cat-  Code: 
Op,  Behav.  Code 

Opinion 

Physiological 


1.,  4.1.10 
1.,  2.,  3. 

Rating  scale 

Questionnaire 

Heart  rate 
h.r.  var. 


Experimental 


Field  Background 


Casey,  S.  M. ,  Breitmaier,  W.  A.  and  Nason,  W.  E.  Cerebal  activation  and  the 
placement  of  visual  displays.  Warminster,  Pennsylvania:  U.S.  Naval  Air 
Development  Center,  NADC-77247-40,  August,  1977. 

Previous  studies  have  shown  that  the  human  cerebral  hemispheres  are  functionally 
asymmetrical.  In  addition,  differential  hemispheric  activation  has  been 
brought  about  by  shifts  in  lateral  visual  orientation.  In  view  of  this  information, 
an  experiment  was  conducted  to  study  the  effects  of  the  lateral  placement  of 
displays  with  spatial-type  information  on  human  performance.  Thirty  two  right- 
handed  males  were  required  to  respond  to  peripherally-located  engine  monitoring 
displays  while  performing  a  central,1  -located  compensatory  tracking  task.  For 
half  of  the  subjects  the  engine  monitoring  displays  were  presented  to  the  left 
of  the  tracking  display  end  for  the  other  half  the  engine  monitoring  display? 
were  presented  tc  the  right  of  the  tracking  display.  Performance  was  found  to 
be  better  for  those  subjects  who  were  required  to  orient  to  the  left  than  for 
those  who  were  required  to  orient  to  the  right.  The  results  of  t%is  experiment 
support  the  theory  that  cerebral  activation  may  be  an  important  consideration 
when  locating  certain  types  of  visual  displays  in  a  high  workload  cockpit 
environment. 

W/I.  Cat.  Code:  3.1,  4.1.7 

Op.  Behav.  Code;  1.,  2«,  4. 

Primary  task  Single  measures  Construct  Flight:  simulator  Flight  simulator 

Physiological  Experimental  Flight  test 
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i  i  *  > 

Catlett*  R.  L.  Application  of  information  theory  concepts  to  study  work  edmplex 
versus  operator  action  time.  Red  River  Army  Depot*  Texarkana,  Texas:  USAMC 
Intern  Training  Center,  USAMC-ITC-2-73-08,  Kerch,  1973.  <AD  786  286). 

Information  Theory  Concepts  are  currently  being  applied  to  obtain  a  quantitative 
measure  of  work  difficulty  or  complexity.  This  paper  uses  information  theory  to 
investigate  the  relationship  betveen  lnformatlcu  input  and  operator  response' time. 
To  investigate  this  relationship,  twelve  male  subjects  were  tested  for  reaction 
time.  Stimuli  were  any  possible  pattern  of  eight  lights.  Responses  were 
corresponding  patterns  of  stimvltaneous  key  depressions  In  an  eight-key  keyboard, 
(one  key  for  each  finger) .  The  conclusion  drawn  from  these  experiments  was  that 
there  seems  to  be  a  linear  relationship  between  information  input  (log2N,  where 
N  is  the  number  of  equally  likely  alternatives)  and  operator  reaction  time  for 
an  unlearned  task. 

W/L  Cat.  Code:  2.1.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4.1 

Spare  m.  capacity  Inform,  theory  Experimental  Laboratory  Flight  simulator 

Primary  task  Single  measures  Flight  test 


Cavalll,  D.  Discrete  time  modeling  of  heavy  transport  plane  pilot  behavior- 
workloads  during  landing.  Proceedings  of  the  13th  Annual  NASA-l'niversity 
Conference  on  Manual  Control,  Massachusetts  Institute  of  Technology,  June 
15-17,  1977,  321-328. 

A  digital  computer  program  simulating  the  reactions  of  the  pilot  of  a  transport 
aircraft  during  final  descent  is  described.  Experimental  data  obtained  from 
monitoring  human  pilots  during  simulated  final  descents  permit  formulation  or  a 
model  decision-making  strategy  involving  nine  instrument  readings  (localized 
deviation,  glide  path  deviation,  roll,  pitch,  yaw,  vertical  speed,  thrust, 
altitude,  and  airspeed).  Recognition  of  a  difficulty  and  the  sequence  of 
corrective  procedures  undertaken  are  also  described.  It  is  concluded  that  a  better 
information  dicplAy  could  significantly  decrease  the  pilot's  workload  and  thus 
improve  flight,  safety. 

W/L  Cat.  Code:  3.1-.  3.3,  4.1.7 

Op .  Behav .  Code :  1 . ,  2 . ,  \ . 

Primary  task  Single  measures  Co no true t  Flight  simulator  Flight  simulator 

Physiological  Math,  model  Experimental 

Eye  movement 
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Ceder ,  A.  Driver's  eye  movements  as  related  to  attention  in  simulated 
traffic  flow  conditions.  Hunan  Factors.  1977,  19,  571-581. 

Drivers'  eye-movement  amplitude  end  fixation  duration  are  studied  in  four 
simulated  traffic  flow  conditions:  (1)  within  frea-flow  node,  (2)  under 
maximum  flow  conditions,  (3)  within  congested-flow  mode,  and  (4)  on  an  urban 
street  between  signalized  intersections.  Of  major  interest  is  the  possible 
correlation  between  eye-movement  data  and  drivers’  attention  demands.  This 
correlation  is  based  on  an  uncertairty  theoretical  model  which  provides  a 
quantitative  approach  for  evaluating  drivers'  attention  level  in  various 
traffic  flow  conditions.  Some  applications  to  traffic  flow  phenomena  are 
presented. 

W/L  Cat.  Code:  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Eye  movement  Experimental  Laboratory  Flight  simulator 


Chalnova,  L.  D. ,  Komarova,  I.  A.  and  Zonabend,  F,  I.  Complex  poychophysiological 
evaluation  of  the  readability  of  symbolic  information  (Koraplekanaya 
Psikhofiziologicheskaya  Ctsenka  Chitaemostl  Znakovoy  Informatsil) .  Voprosy 
Psikhologii,  1970,  6 ,  163-168.  (Royal  Aircraft  Establishment  Library 

Translation  1777,  1974;. 


Slides  of  conventional  cartographic  symbols  varying  In  number  were  exposed 
for  two  seconds  and  their  recognition  difficulty  determined.  Twelve  such 
symbols  were  selected  experimentally  to  cover  the  range  of  difficulty. 
Recordings  were  then  made  on  ten  subjects  of  their  EEC,  GSR,  EMG  and  electro¬ 
oculogram  (EOG)  in  e  recognition  task  in  which  the  number  and  difficulty  of 
the  symbols  were  varied.  The  GSR,  EOG  and  EEG  measures  were  found  to  reflect 
the  condition  of  the  visual  system  best.  The  results  obtained  make  it  possible 
to  make  decisions  regarding  information  saturation  of  the  visual  field,  ways 
of  representing  symbol?,  exposure  time,  and  individual  differences. 

W/L  Cat.  Code:  3.1,  4.1.2,  4.1.4,  4.1.5,  4.1.7,  4.1.10 

Op .  Behav .  Code :  1 . ,  2 . ,  4 . 

Primary  task  Multiple  Experimental  Laboratory  Flight  simulator 
Physiological  Flight  test 


58 


sy-u:r-so 


Childs,  J.  M.  The  development  of  objective  ini light  performance  asses eosnt 
procedures .  Proceed luge  of  the  23rd  Annuel  Meeting  of  the  Hunan  Factors 
Society,  Boston,  Mafisachusetts,  October  29-Noveeber  1,  1979,  329-333. 


The  purpose  cf  this  research  was  to  develop  procedures  f. or  objectively  evaluating 
Initial  Entry  Rotary  Wing  (IERW)  student  performance  in  flight.  Maneuvers  of  the 
Basic  Instrument  phase  were  addressed.  Inscriptive  inflight  scoring  procedures 
to  assess  absolute  deviations  of  daslrad  values  from  observed  values  at  designated 
times,  were  developed.  Desired  values  were  determined  on  the  basis  of  the  rates 
specified  in  IE.IW  training  guides.  Observed  values  were  instrument  indications 
of  airspeed,  altitude,  or  heading  at  those  times.  Four  tolerance  categories  were 


incorporated  intJ  alternative  six-point  maneuver  scoring  algorithms  designed  to 
assess  aircraft  control  precision.  The  criterion  for  acceptable  proficiency  was 
the  maintena  *  a.  cf  each  sampled  measure  within  standard  IERW  tolerance  limits  for 
each  sampiin,  pcint  of  a  maneuver.  Tests  of  the  objective  scoring  procedures 


were  conduced  in  the  UH-1  flight  simulator. 


W/L  Cec.  Code:  3.1 

I 

Cp.  I*ehav.  Code:  1.,  2.,  4. 


Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 


\ 


Chiles  W.  D.  Objective  methods  for  developing  indices  of  pilot  workload. 

Oklahoma  City,  Oklahoma:  Federal  Aviation  Administration,  Civil  Aeromedlcal 
Institute,  FAA-AM-77-15,  July,  1977. 

This  paper  discusses  the  various  types  of  objective  methodologies  that  either 
have  been  or  have  the  potential  of  being  applied  to  the  general  problem  of  the 
measurement  of  pilot  workload  as  it  occurs  on  relatively  short  missions  or 
mission  phases.  Selected  studies  Chat  have  dealt  with  the  workload  measurement 
problem  or  some  similar  problem  are  reviewed  in  relation  to  their  applicability 
to  securing  answers  to  operational  questions.  The  types  of  methods  are 
classified  as:  laboratory,  analytic  and  synthetic,  simulator,  and  in-flight. 
The  paper  concl.'dss  with  a  general  discussion  of  the  relative  merits  and  some 
of  the  cautions  to  be  observed  in  attempting  to  apply  these  methods  and  in 
trying  to  interpret  the  results  with  a  view  toward  generalizing  to  operational 
situations. 

W/L  Cat.  Code:  2.,  3. 

Op.  Behav.  Code;  1.,  2.,  3.,  4. 

Spare  u.  capacity  Multiple  Review  None  Flight  simulator 

Primary  task  Flight  test 
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Chiles,  W.D.  Objective  method*.  In  A.H.  Roscoe  (Ed.)  Assessing  pilot 
workload .  AG ARD- AG-233,  February,  1978,  54-77.  (AD  A051  537). 

The  general  approaches  that  we  have  labelled  "laboratory  methods"  are  probably 
best  suited  to  conducting  background  research  cn  more  general  questions  pertaining 
to  workload.  Wherever  they  are  appropriate  they  are  the  method  of  choice  because 
of  the  typically  high  degree  of  control  possible  and  the  attendant  high  levels 
of  reliability.  The  synthetic  work  method  is  especially  well  suited  to  examining 
general  workload  questions  because,  by  its  nature,  tastes  caS  be  added,  removed, 
and  modified  with  relative  ease,  and,  depending  on  the  overall  level  of  complexity, 
large  Investments  in  training  time  are  not  required.  Ihe  analytic  and  the 
synthetic  methods  both  appear  to  yield  reasonable  results,  but  both  techniques 
~est  on  relatively  fragile  data  bases.  Simulators,  especially  those  controlled 
by  general  purpose  digital  computers,  have  the  potential  of  generating  large 
amounts  of  very  useful  information  on  workload.  However,  whether  the  programs 
that  resulted  in  their  acquisition  will  allow  adequate  access  to  such  systems  for 
research  purposes  remains  to  be  seer.  Except  for  some  of  the  safety  limitations, 
in-flight  methods  can  be  used  on  virtually  any  problem  suitable  for  investigation 
in  a  simulator.  However,  the  recording  of  data  of  demonstrated  reliability  is 
a  significant  problem. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 

2.,  3. 

1.,  2.,  3.,  4. 

Spare  m.  capacity 
Primary  task 

Multiple 

Review 

None 

Flight  simulator 
Flight  test 

Chiles,  W.D.  and  Alluisi,  E.A.  A  review  of  methods  for  specifying  operator  or 
occupational  workload.  Paper  presented  at  XIXth  International  Congress  of 
Applied  Psychology,  Munich,  Germany,  August,  1978. 


Laboratory,  analytic,  synthetic,  simulation,  and  operational-system  methods 
employed  in  the  specification  of  performance  workloads  are  reviewed.  It  is 
concluded  chat  laboratory  methods  re  the  methods  of  choice,  with  the  synthetic- 
work  technique  especially  well  suited  to  examinations  of  general  workload. 

Analytic  and  synthetic  methods  yield  reasonable  results,  but  both  rest  on 
relatively  fragile  data  bases.  Simulation  methods  have  the  potential  of  providing 
quite  useful  information  on  operator  workload,  but  simulators  have  not  generally 
been  employed  for  this  purpose,  and  some  of  the  difficulties  implicit  to  their 
use  are  discussed.  Operational-system  methods  can  be  uoed  on  virtually  any  work¬ 
load-specification  problem  suitable  for  investigation  in  a  simulator,  but  the 
problems  of  data  recording  can  be  substantial. 


W/L  Cat.  Code:  3. 

Op .  Behav .  Code :  1.,  2.,  3.,  4. 

Spare  m.  capacity  Multiple  Review  None 

Primary  task 


Flight  simulator 
Flight  test 
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Chiles,  W.  D.  a ud  Alluiai,  E.  A.  O'  tha  specification  of  operator  or  occupational 
workload  with  parformanca-msasuraatnt  methods.  Human  Factors,  1979,  21, 

515-528. 

Five  system-output  or  performance-meesureasnt  methods  have  been  described  in  the 
literature  for  use  in  operator  or  occupational  workload  specifications:  laboratory, 
analytic,  synthetic,  simulation,  and  operational-system  methods.  A  review  and 
analysis  of  these  methods  indicates  that  laboratory  methods,  where  appropriate, 
are  the  methods  of  choice,  with  the  synthetic-work  technique  especially  well  suited 
to  examinations  of  general  workload  questions.  Analytic  and  synthetic  methods 
appear  to  yaild  reasonable  results,  but  both  rest  on  relatively  fragile  data 
bases.  Simulation  methods  have  the  potential  of  providing  quite  useful  information 
on  operator  workload,  but  simulators  have  not  generally  been  employed  for  this 
purpose,  and  some  of  the  difficulties  implicit  to  their  use  are  discussed^ 

|  Operational-system  methods,  except  for  some  possible  safety  limitations,  can  be 
'  used  on  virtually  uny  workload-specification  problem  suitable  for  investigation 
in  a  simulator,  but  the  problems  of  data  recording  can  be  substantial. 


W/I.  Cat.  Code: 

2.1,  2.2,  3.1,  3.2 

Op.  Dehav.  Code: 

1.,  2.,  5. ,  4. 

Spare  m.  capacity 

Multiple  Review 

None 

Flight  simulator 

Primary  task 

Flight  test 

Chiles,  W.  D.,  Jennings,  A.  E.,  aid  AJluisi,  F,.  A.  Measurement  and  scaling  of 
workload  in  complex  performance.  Aviation,  Space  ana  Environmental  Medicine, 
1979,  50,  -  376-381.  . . ~ 

A  method  is  developed  for  scaling  different  le/els  of  workload  on  human  operators 
Involved  in  man— machine  systems.  A  multiple  task  perforvuar xr.e  battery  is  uoed 
to  provide  several  tasks  (monitoring  lightc ,  monitoring  meters,  two-dimens ioas l 
compensatory  tracking,  pattern  identification,  ff»eiital  arithmetic,  and  problem 
solving)  in  different  combinations  to  gcuecate  varying  job  demands  and, 
presumably,  varying  levels  of  workload.  A  total  of  94  volunteer  male  subjects 
is  tested,  divided  in  two  groups  tested  on  one  and  two  day? ,  respectively.  A 
scale  of  workload  is  derived  for  five  complex  task  combination  conditions.  The 
scale  provided  reliable  values  that  were  stable  on  rep IJ cation.  The  mejor 
restriction  to  the  method's  use  is  the  requi reliant  of  employing  at  least  50 
subjects  to  yield  stable  scale  values. 


W/L  Cat.  Code:  2.2,  3.1.  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 


Spare  ra.  capacity  Secondary  task  Experimental  Laboratory 
Primary  task  Single  measures 

Multiple  measures 


Flight  simulator 
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Chu,  i .  and  Rouaa,  W.  0.  Optimal  adaptive  allocation  of  decision  making 
responsibility  between  human  and  computer  in  multi-task  situations 
Proceedings  of  the  1977  International  Conferap.ee  on  Cybernetics  and 
Society .  Washington,  D.C  ,  September,  197?,  168-175. 

It  is  suggested  that  the  computer  serve  as  a  backup  decision  maker  in  multi¬ 
task  situations  -  accepting  responsibility  when  workload  becomes  uxceselve 
and  relinquishing  respons-'b^1  ity  when  workload  becomes  acceptable.  A 
queueing  theory  formulation  of  multi-task  decision  making  ie  used  to  develop 
a  procedure  for  determining  when  the  computer  should  be  assigned  decision 
making  responsibility.  The  procedure  is  illustrated  by  application  to  s 
computer-sided  flight  management  situation. 

W/L  Cat.  Code:  5.3 

Op.  Behav,  Code:  1.,  2.,  3.,  4. 

Primary  tack  With,  model  Construct  Laboratory  Flight  simulator 

Experimental 


Clark,  L.  A.,  Aruolt.  ,  E.  L.,  Foulda ,  E.  L.,  Jr.,  Brown,  D.  M.,  Eastmead,  D.  R., 
and  Parry,  E.  K.  Aviction,  Space,  and  Environmental  Medicine,  1975,  46,  1044- 
1048. 


Studies  vein  conducted  to  upturning  the  psychological  correlates  of  elevated 
serv.B?  urate  and  cholsoterol  levels.  Elevations  of  uric  acid  level  appeared  to 
reflect  stress  that  excited  fear  or  insecurity,  while  high  cholesterol  levels 
seemed  to  reflect  a  stress  which  the  individual  perceived  as  requiring  a  sustained 
*ncroA8e  in  physical  and/or  mer.^al  performance. 

W/L  Get.  Code:  4.1.12 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Physiological  Eody  fluid 

anal . 


Experimental  Laboratory  Flight  simulator 

Flight  teas 
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Clark,  W.  E. ,  ar.  and  Armstrong,  G.  C.  Three-rvie  helicopter  flight  director 
evaluation.  Randolph  APB,  Toxas:  USAP  Instrument  Plight  Center,  IFC  TR 
77-3,  July,  1977. 

Thin  report  covers  the  work  accomplished  during  an  inflight  investigation 
concent ing  the  evaluation  of  the  change#  in  pilot  performance,  control  activity 
and  biochemical  changes  while  flying  with  various  display  configurations  of  a 
helicopter  Three-Cue  Flight  Director  System.  A  series  ot‘  objective,  subjective, 
and  physiological  measures  were  used  to  evaluate  the  various  display  configurations. 

W/L  Cat.  Code:  1.2,  3.2,  4,1.10,  4.1.12 


Op.  Bahsv.  Co* 

e -  1.2,  2.,  4. 

Opinion 

Questionnaire 

Experimental 

Flight  tent 

Flight 

simulator 

Primary  task 

Malt .  measures 

Flight 

test 

Physiological 

lleeit  rate 
h . i .  var . 

Body  fluid  anal. 


Clement,  W.F.  Investigating  the  use  of  a  moving  map  display  and  a  horizontal 
situation  indicator  i.n  simulated  powered-lift,  short-haul  operationo. 
Proceedings  of  the  12th  Annual  NASA-University  Conference  on  Manual  Control, 
University  ot  Illinois,  Ma>,  197S,  201-224.  (NASA  TMX =73170) . 


This  research  investigates  the  use  of  a  moving  mop  display  from  enroute  through 
Che  terminal  area,  including  aporoack  and  go-around.  Various  features  of  each  of 
the  primary  STOLAND  displays,  the  electronic  movin3  map  multifunction  display 
(MFD),  horizontal  situation  indicator  (HSI),  and  electronic  attitude  director 
indicator  (EADI) ,  are  usgv  in  the.  three  phases  of  flight  mentioned  above  when  the 
STOIAND  ry3tem  is  operated  in  each  of  three  ways:  a)  flown  in  ths.  fully  automatic 
mode  with  the  pilot(s)  in  a  monitoring  role;  5)  flown  manually  using  flight 
director  guidance  to  reduce  workload  and  task  requirements  in  cn  acceptable  level; 
of  c)  flown  manually  using  raw  instrument  situation  data.  Eye-poirt-of~regnrd 
and  workload  measurements,  coupled  with  task  performance  measurements,  pilot 
opinion  ratings,  and  pilot  comments  are  presented.  The  measurements,  ratings,  and 
comments  provide  an  indication  of  the  utility  of  the  MFD  as  &  supplement  to  the 
HSI  for  improving  flight  safety. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 

Opinion 

Spa  e  m.  capacity 
Primary  task 
Physiological 


1.1,  2.2,  3.2,  4.1.7 

1 . ,  2. ,  4 . 

Multiple  Experimental  Flight  simulator  Flight  simulator 

Flight  test 
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descent,  W.  Annotate.!  bibliography  of  procedures  which  assess  primary  task 
performance  in  some  manner  as  the  basic  element  of  a  workload  measurement 
procedure.  Hawthorne,  Calif.:  Systems  Technology,  Inc.,  Technical  Report 
No,  1104-2,  January,  1978. 

The  survey  endeavors  to  include  ail  contributions  back  to  1970  with 
special  effort  to  identify  papers  nor  contained  in  formal  journals;  that  is, 
papers  presented  at  meetings  or  only  available  in  non-archival  proceedings, 
etc.  Major  theoretical  or  bibliographic  review  articles  including  sources 
extending  hack  to  11>50  have  been  included  in  the  search.  The  annotated 
bibliography  provides  complete  references  to  each  relevant  contribution  and 
an  abstract  of  each  with  a  brief  summary  of  results  or  findings.  Except  for 
the  major  surveys  and  conference  proceedings,  which  are  arranged  chronologically, 
the  contributions  within  each  subtopic  are  arranged  alphabetically  by  the  first 
author's  name. 

W/L  Cat.  Code:  2.2,  3.1,  3.3,  4.1.7 

Op.  Behav.  Code:  3. ,  2. ,  4. 


Primary  task  Multiple 

Review 

Ncne 

Flight  simulator 

Spare  m.  capacity 

Flight  test 

Physiological 

Clement,  W.  F.,  Hofmann,  L.  G.,  and  Graham,  D.  A  direct  procedure  for 

partitioning  scanning  workload  with  a  flight  director.  Proceedings  of  the 
IEEE  Cybernetics  and  Society  International  Conference,  Boston,  Massachusetts, 
November,  1973,  38-43. 

Recent  experimental  eye  scanning  measurements  from  simulated  approaches  in  a 
flight-like  cockpit  representing  a  contemporary  jet  transport  have  cade  it  possible 
to  simplify  the  procedure  for  predicting  the  partition  of  the  pilot's  scanning 
workload  required  for  monitoring  and  controlling  a  task  with  status  displays  and 
a  flight  director.  W her  there  is  but  a  single  director  control  display,  the  new 
procedure  eliminates  iteration  in  the  preliminary  design  computations.  The 
preliminary  design  computations  are  baaed  on  predictions  of  closed— loop  input- 
correlated  errors  in  displayed  variables  with  respect  to  the  trimmed  flight 
values.  Also  included  are  methods  for  predicting  multiloop  error  coherence,  and 
for  correcting  the  predicted  ;artltion  of  scanning  workload  when  the  pilot's 
scanning  remnant  contribution  is  significant. 


W/L  Cat.  Code:  2.1.1,  3.3 

Op .  Behav ,  Code :  1 . ,  2 . 


Spare  m.  capacity  Task  comp., 

time  assess. 

Primary  task  Mach,  model 


Construct 


None 


Flight  simulator 
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Clement,  W.  F.,  Jex,  H.  R.  and  Graham,  D.  A  manual  control- Display  theory  applied 
.  to  instrument  landings  of  4  jet  transport.  tlEEB  Transactions  on  Man-Kaohine 
Systems,  1968,  MMS-9.  93-109. 

This  p^per  presents  an  illustrative  application  of  a  theory  for  manual  control 
displays  to  the  instrument  landing  approach  of  a  large  subsonic  jet  transport. 

A  methodical  procedure  is  disclosed  for  formulation  of  compensatory  display- 
control  systems.  Manual  approach  height  and  lateral  position  control  are  treated 
in  multDoop  dynamic  analyses  so  as  to  select  preferred  variables  for  measurement 
and  display.  Cloned- loop  system  performance  and  pilot  scanning  and  workload 
measures  are  also  evaluated.  The  example  concludes  with  the  "prediction"  of  a 
preferred  display  arrangement.  Comparison  with  an  FAA  Category  II  instrument 
panel  arrangement  selected  by  an  airline  operating  the  example  aircraft  shows 
the  predictions  to  be  remarkably  accurate,  'n  regard  to  workload  a  procedure 
similar  to  that  of  Senders  is  used.  Fraction  il  workload  techniques  are  developed 
on  the  basis  of  summation  of  fixation  frequency-mean  dwell  time  products. 

W/L  Cat.  Code:  1-1.1,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Task  comp. ,  Construct  None  Flight  simulator 

time  assess. 

Primary  task  Math,  model 


Clement ,  W.  F.,  Jex,  H.  R.  and  Jrab&m,  D.  Application  of  a  systems  analysis 

theory  for  manual  control  di  leys  to  aircraft  instrument- lauding.  P coceedings 
of  the  4th  Annual  HASA-Uni. varsity  Coufecjr e  oa  Manual  Control,  Arm  Arbor, 
Michigan ,  March,  1966,  69-94.  (NASA  S^-192). 

This  paper  presents  an  illustrative  epplieation  cf  a  theory  for  manual  control 
displays  to  the  instrument  landing  approach  of  a  large  subsonic  jet  transport. 

A  methodical  procedure  is  dircloeed  for  formulation  cf  compensatory  display/ 
control,  system*?.  Manual  approach  height  and  lateral  position  control  are 
treated  in  mvlti'.'/op  dynamic  analyses  so  as  to  select  preferred  variables  for 
measurement  and  display.  Closed-loop  system  performance  and  pilot  scanning 
and  workload  measure*!  are  also  evaluated.  Tha  example  concludes  with  the 
prediction  of  a  preferred  display  arrangement.  Comparison  with  an  FAA  category 
II  instrument  panel  arrangement  selected  by  a.i  ait-line  operating  the  example 
aircraft  shows  tha  predtetiens  to  be  remarkably  accurate. 

W/L  Cat.  Code  *  2.1.1  3.3 

up.  Behav.  Code:  1.,  4, 

Spare  u  capacity  Task  comp. ,  Construct  None  Flight  simulator 

time  assess. 

Primary  tnsk  Math,  model 
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Clement,  W.F.,  McRuer,  D.T.  and  Klein,  R.H  Systematic  manual  control  display 
design .  Proceeding^  of  the  AOARD  Conference  on  Guidance  end  Control  Displays, 
AGARD-CI -96,  6-1  -  6-10. 

A  theory  of  displays,  together  with  validated  techniques  for  analysing  closed- 
loop  pilot-vehicle  dynamic  performance,  provides  e.  systematic  procedure  for 
improving  the  guidance  and  control  display  design  process.  Centre!  to  this 
theory  is  the  notion  that  display  design  is  fundamentally  a  guidance  and  control 
problem  which  has  interactions  with  our  knowledge  of  human  psychomotor  activity. 

We  review  the.  inspirations  for  eye  movement  studies  in  flight  control  and 
monitoring  tasks  and  summarize  the  relationship  of  eye  scanning  phenomena  to  pilot 
describing  functions  and  remnant.  Several  measures  of  pilot  workload  in  control 
tasks  are  discussed.  One  measure,  in  particular,  has  great  promise  in  quantifying 
a  practical  definition  of  workload.  This  Is  excess  control  capacity.  We  conclude 
by  illustrating  the  further  connections  with  lead  equalization,  scanning  workload, 
physiological  measures  of  neuromuscular  tension,  and  the  effects  of  additional 
modalities  on  visual  workload. 

W/L  Cat.  Code:  1.1,  2.2.5,  3.3,  4.1.7,  4.1.9 

Op .  3-lhav .  Code :  1 . ,  2 . ,  4 . 

Opinion  Multiple  Construct  Laboratory  Flight  simulator 

Spare  m.  capacity  Experimental  Flight  simulator  Flight  test 

Primary  task 
Physiological 


Cliff,  R.  C.  The  effects  cf  attention  sharing  in  a  dynamic  dual-task  environment. 
Proceedings  of  the  7tu  Anuual  NASA-Universlty  Conference  on  Manual  Control, 
University  of  Southern  California,  June,  1971,  307-325.  (NASA  SP-281) . 

There  are  nuui^rous  examples  of  cases  where  the  human  operator  is  confronted 
with  several  tasks  occurring  simultaneously  and  continuously  in  time.  The 
current  study  i *  on  investigation  into  the  nature  of  attention  sharing  between 
two  continuous  tasks  with  independent  input-output  modes.  Eleven  sublects 
wett  teatesd  using  a  zero  erder  compensatory  control  task  with  three  levels  of 
difficulty  (Inpot  bandwidth)  for  each  subject  As  a  secondary  task  on  half  of 
the  trials,  the  subjects  weie  also  required  to  verbally  shadow  a  random  auditory 
input.  Results  from  an  extensive  time  and  frequency  domain  analysis  of  the 
data  are  presented  and  discussed.  The  evidence  supports  a  single  channel  model 
for  continuous  dual-task  control. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  fiehav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 
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Cohen ,  S.  I.  and  Silverman,  A.  J.  Measurement  of  pilot  mental  effort.  Paris, 
France:  North  Atlantic  Treaty  Organization,  Advisory  Group  for  Aeronautical 
Research  and  Development,  Report  148,  May,  1957.  (AD  200  672). 

This  paper  discusses  the  factors  which  affect  a  pilot's  ability  to  respond 
to  situations  demanding  effort  and  methods  of  measuring  his  total  psycho- 
physiologic  response.  A  description  is  given  of  some  methods  and  quantitative 
results  obtained  in  research  at  the  Aeromedical  Laboratory  of  the  Wright- 
Patterson  Air  Force  Base. 

W/L  Cat.  Code:  4.1.2,  4.1.5 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Physiological 

GSR 

Construct 

Laboratory 

Flight  simulator 

EEG 

Experimental 

Flight  test 

;  Colie,  H.A.  and  DeMaio,  J.C.  The  use  of  dual-task  performance  operating  curves 

to  assess  workload .  Paper  presented  at  the  1978  Review  of  Air  Force  Sponsored 
•  Basic  Research  in  Flight  and  Technical  Training,  U.S.  Air  Force  Academy, 

|  Colorado  Springs,  Colorado,  April,  1978. 

f  A  preliminary  study  generated  performance  operating  curves  (POC)  for  two  digit 

i  transformation  tasks  (repeat  the  digit,  add  three  and  report  the  sum)  each  of 

>  which  were  combined  with  a  tone  classification  task.  Two  POCs  were  generated 

\  which  allowed  the  two  digit  transformation  tasks  to  be  equated  in  attentional 

I  demand  over  a  wide  range.  Pilots  also  were  tested  in  a  formation  flying 

|  simulator  together  with  the  tone  classification  task.  Although  the  formation 

I  flying  tasks  did  make  workload  demands,  they  were  small  in  comparison  with  those 

I  made  by  the  digit  transformation  tasks,  as  would  be  expected  for  an  overlearned 

|  task.  Currently,  the  additivity  of  the  equivalent  demand  procedure  is  being 

|  investigated. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  1.,  2.,  4. 

I 

I  Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
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Control-display  pilot  factors  program.  Randolph  AFB,  Texas:  USAF  Instrument 
Pilot  Instructor  School,  Instrument  Evaluation  Project  NR. 63-1,  December, 

1963. 

Intervening  levels  of  control  between  full  manual  and  full  automatic  were 
examined  for  the  purpose  of  determining  the  compatibility  of  the  human  pilot’, 
with  an  automatic  flight  control  system  using  Force  Wheel  Steering  as  the  link 
between  the  two  elements.  Two  identically  equipped  T-39  aircraft  were  utilised 
in  the  inflight  examination.  Twenty-six  pilots  representing  commercial  airlines, 
FAA,.  and  the  USAF  flew  every  possible  combination  of  the  two  levels  of  control 
in  pitch,  and  three  levels  of  control  in  roll,  a  total  of  five  times;  two  times 
wore  for  training  and  three  times  for  record.  The  standard  T-39  panel,  featuring 
the  USAF  Flight  Director  Display,  was  used.  The  profile  consisted  of  the  TLS 
final  approach.  All  approaches  were  made  under  the  hood.  Standardised  briefings 
and  procedures  were  utilized.  Both  subjective  and  objective  measures  were 
obtained  for  describing  the  effects  of  intervening  levels  of  control  upon 
pcrtormance.  Comparable  performance  was  obtained  across  the  intervening  levels 
of  control  indicating  compatibility.  A  reduction  in  pilot  work  load,  unburdening, 
was  obtained  as  a  function  of  increasing  levels  of  automation.' 

W/L  Cat.  Code:  1. ,3.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  test  Flight  simulator 

Primary  task  Questionnaire  Flight  test 

Mult,  measures 

Cooper,  G.  E.  and  Harper,  R.  P..  Jr.  The  use  of  pilot  rating  in  the  evaluation 
of  aircraft  handling  qualities.  Moffett  Field,  California:  National 
Aeronautics  and  Space  Administration,  Ames  Research  Center,  NASA  TN-D-5153, 
April,  1969. 

Pilot  rating  scales  and  their  use  in  assessing  aircraft  handling  qualities  are 
reviewed  historically,  and  objections  that  have  been  raised  to  limitations  of 
earlier  scales  are  considered  in  the  developmer  of  a  revised  scale.  Terminology 
used  in  the  evaluation  of  handling  qualities  is  reviewed  and  new  definitions 
are  proposed  to  improve  communication  and  International  understanding.  Of 
particular  significance  is  the  new  definition  of  handling  qualities,  which 
emphasizes  the  importance  of  factorc  that  influence  the  selection  of  a  rating 
other  than  stability  and  control  characteristics.  The  experimental  use  of 
pile;,  rating  is  discussed  in  detail,  with  special  attention  devoted  to  (1) 
clarifying  the  difference  between  mission  and  task,  (2)  identifying  what  the 
rating  applies  to,  (3)  considering  the  pilot's  assessment  criteria,  and  (4) 
defining  the  simulation  situation.  The  Important  elements  of  the  report  are 
then  summarized  in  a  suggested  "Briefing  Guide,"  designed  for  guidance  in 
planning  and  executing  handling  qualities  experiments. 

W/L  Cat.  Code:  1.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Construct  Flight  test  Flight  simulator 

Flight  test 
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SY-27R-80 


Cor kind ale,  M.G.G.  A  flight  simulator  study  of  missi-le  control  performance  as 
a  function  of  concurrent  workload.  Proceedings  of  the  AGARD  Conference  on 
Simulation  and  Study  of  High  Workload  Operations.  AGARD-CP-146,  April,  1974, 

A5-1  -  A5-6. 

Eight  pilots  took  part  in  a  simulation  of  the  delivery  of  a  stand-off  air-to- 
aurface  guided  weapon.  The  attack  phase  of  a  sortie  was  simulated.  Four  levels 
of  workload  were  studied.  The  results  show  that  performance  at  the  missile  control 
tasks  was  degraded  by  increase  in  concurrent  workload,  and  manual  flight  con to 1 
and  auto-pilot  monitoring  were  adversely  affected  by  concurrent  missile  control 
tasks.  A  small  group  of  non-pilots  was  put  through  the  same  experimental  program. 

A  similar  pattern  of  results  to  those  of  the  pilot  group  were  obtained  but  the 
absolute  levels  of  performance  were  predictably  different.  Eye  movement  data  and 
subjective  data  allow  the  deterioration  in  two-task  performance  to  be  explained. 

The  results  of  this  study  confirm  laboratory  secondary  task  experiments  in  that  a 
deterioration  in  primary  task  performance  is  associated  with  the  occurrence  of  a 
secondary  task. 

W/L  Cat.  Code:  1.2,  2.2.2,  4.1.7 

Op.  Behav.  Code:  1.,  2..  4.2 

Opinion  Questionnaire  Experimental  Flight  simulator  Flight  simulator 

Spare  m.  capacity  Subsidiary  task  Flight  test 

Physiological  Eye  movement 


Coriett,  E.  N.  Cardiac  arrhythmia  as  a  field  technique:  Some  comments  on  a 
recent  symposium.  Ergonomics ,  1973,  16,  3-4. 

The  seminar  on  "Heart  Rate  Variability  and  Mental  Load"  at  which  the  papers 
in  this  issue  were  presented  was  attended  mainly  by  research  workers  and 
presented  by  researchers.  The  examples  given  and  problem  areas  posed  in  these 
papers  are  either  actual  field  studies  or  analogues  of  field  situations.  It 
is  not  unreasonable  therefore  to  look  at  the  work  reported  in  relation  to  Its 
contribution  to  the  study  of  mental  work  and  mental  load,  not  in  any  carping 
spirit  but  to  Indicate  the  enormity  of  the  task  facing  the  field  worker  who  is 
studying  mental  work.  This  approach  will  also  indicate  the  quality  of  personnel 
which  will  be  needed  in  Industry  if  this  area  ia  to  be  adequately  treated.  To 
say  the  least,  it  seems  unlikely  that  industry  will  be  able  to  continue  with 
the  use  of  simple  techniques  and  technician  level  personnel  for  the  study  of 
work  loads  arising  from  modern  industrial  jobs.  The  seminar  gave  a  clear 
indication  that  the  study  of  working  stress  requires  a  professional  level  of 
training,  i.e. ,  one  equivalent  at  least  to  a  chartered  engineer  in  quality.  If 
the  effective  interpretation  of  data,  which  are  in  themselves  reliable,  is  to 
be  achieved. 

W/L  Cat.  Code:  4.1.10 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Heart  rate.  Review  None  Flight  simulator 

h.r.  var. 


J 
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SY-27R-30 


CculuriSj  G.  J.,  Rataer,  R.  S. ,  Petr seek,  S.  J. ,  Wong,  P»  J.  and  Ketchel,  J.  M. 
Capacity  Mac  productivity  implications  on  enroute  sir  traffic  control 
automation.  Washington,  D.C.:  Federal  Aviation  Administration,  FAA-RD-7/-196 , 
December,  1974.  (ADA  016  622). 

This  report  documents  the  work  performed  by  Stanford  Research  Institute  (SKI) 
to  evaluate  controller  productivity  and  capacity  benefits  potentially  realisable 
from  postulated  evolution  of  ensoutu  air  traffic  control  (ATC)  automation.  This 
work  focused  on  the  workload  limitations  of  human  controllers  and  the  effects 
on  controllers  of  various  automation  applications  to  National  Airspace  System 
(NAS)  Stage  A3d.2  ATC.  Empirical  measurements  of  routine,  surveillance,  and 
conflict  processing  nctlvities  were  used  to  develop  workload  models  of  control- 
team  operations.  These  svodels  are  extensions  of  the  Relative  Capacity  Estimating 
Process  (RECBP)  previously  developed  by  SRI.  They  were  used  to  assess  the 
potential  bensfito  of  enhancements  including  an  electronic  tabular  flight  data 
display.  The  workload  models  were  incorporated  into  the  SRI  Air  Traffic  Flew 
(ATP)  network  simulation  model  to  assess  the  potential  benefits  of  a  computerised 
facility- level  traffic  flow  control  method  termed  planning  control. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1. ,  2. ,  3. •  4. 

Spare  m.  capacity  Task  comp.,  Experimental  Field  Flight  simulator 

time  assess. 


Crabtree,  M.S.  Human  factors  evaluation  cf  several  control  system  configurations, 
including  workload  sharing  with  force  wheel  steering  during  approach  and  flare. 
Wright-Patterson  AFB,  Ohio:  USAF  Flight  Dynamics  Laboratory,  AFFDL-TR-'5-43, 
April,  1975. 

An  experiment  was  conducted  to  evaluate  the  performance  and  workload 
characteristics  of  six  types  of  control  system  configurations  during  simulated 
IFR  approaches.  The  six  types  were,  (1)  manual  ILS,  (2)  manual  approach  with 
flight  director, . (3)  semi-automatic  approach  with  flight  director  ia  which  the 
pitch,  roll,  and  yaw  axes  of  the  autopilot  were  controlled  by  the  pilot  through 
force  wheel  steering,  (4)  and  (5)  two  workload  sharing  approaches  with  force 
wheel  steering  ar.d  flight  directors  where,  in  one  case,  the  pilot  controlled 
pitch  and  power  while  the  co-pilot  controlled  roll  and  yaw  and,  in  the  other  case, 
the  roles  of  the  pilot  and  co-pilot  were  interchanged,  and  finally  (6)  a  fully 
automatic  approach.  Conclusions  were  that  the  full  automatic  mode  provided  the 
best  performance  and  lowest  workload  while  the  manual  ILS  mode  and  the  semi¬ 
automatic  mode  provided  the  worst  performance  and  the  highest  workload. 


W/L  Cat.  Code 

1.,  3.2 

Op.  Behav.  Code: 

1«,  2.,  4. 

Opinion 

Rating  scale  Experimental 

Flight  simulator  Flight  simulator 

Primary  task 

Questionnaire 

Mult .  measures 

Flight  test 

’'0 


SY-27R-B0 


Crrvf ord ,  B.  M.  Workload  assessment  methodology  development:.  In  B.  0.  Ksrtman 
end  R.  E.  McKsnr.is  (Eds.)  Survey  of  aithods  co  assess  workload.  ACaRP- AG- 
246,  August .  1979 j  55-67. 

litis  presentation  pro/idee  a  brief  review  of  several  concepts  useful  in  workload 
estimation.  The  first  concept  ia  that:  of  performance  theory,  including  the  work 
of  Teichner  and  Dondus  The  second  concept  is  that  of  divided  attention  with 
emphasis  on  the  work  of  Hick,  Knowles,  and  Sternberg.  Experimental  results  using 
the  Sternberg  psrsdlgm  are  described.  Finally,  physiological  correlates  of 
performance  and  analytic  methodologies  are  briefly  reviewed. 

W/L  Cat.  Code:  2.1,  2.2.1,  3.1,  4.1 

Op  Behav.  Code:  l,,  2.,  4. 

Spare  m.  capacity  Multiple  Review  None  Flight  s  Lmulator 

Primary  task  Construct  Flight  test 

Physiological 


Crawford,  3.  M. ,  Pearson,  W.  H.  und  Hoffman,  K,  Multifunction  switching  and 
flight  control  workload.  Paper  presented  at  the  6th  Psychology  In  the  POD 
Symposium,  U.S.  Air  Force  Academy,  Colorado  Springs,  Colorado,  April,  197.  i. 

Four  subjects  were  tested  i:i  a  cockpit  simulator  using  a  secondary  task  tc 
measure  reserve  Information  processing  capacity  under  two  levels  of  flight 
control  and  four  levels  of  multifunction  switching.  Results  suggest  -hat 
flight  control  Impacts  both  Input-output  and  central  processing  stages  whereas 
mere  anticipation  oJ:  switching  casks  affects  input-output  only.  Difficult 
flight  control  reduced  the  effective  information  processing  reserve,  by  54 
percent  on  the  average.  The  corresponding  losses  attributable  to  anticipation 
or  multifunction  switching  were  20  and  31  percent  for  simple  and  complex  tasks 
respectively.  The  study  has  implications  for  design  of  effective  processing 
aids  and  mental  workload  measurement. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  2.1,  4.1,  4.2 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  rimulator 
Primary  task  Single  measures  Plight  test 
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SY-27R-80 


Cross,  X.D.  and  Cavellero ,  F.R.  Utility  of  the  vertical  contact  analog  display 
for  carrier  landings  -  a  diagnostic  evaluation.  Proceedings  of  the  aGAP.D 
Conference  on  Guidance  and  Control  displays,  AGARD-CP-96,  21-1  -  21-11. 

(AD  739-779). 

An  experiment  was  performed  to  evaluate  the  accuracy  with  which  slmuJnted  carrier 
landings  could  be  performed  with  the  Vertical  Contact  Analog  Display  iVCAD),  a 
pictorial  vertical  situation  display  generated  by  a  digital  computer.  A  secondary 
objective  was  to  generate  diagnostic  data  to  define  the  relative  magnitude  of 
different  potential  contributors  to  total  system  error.  Position  and  attitude 
errors  were  measured  under  each  of  five  experimental  conditions,  a  full-scale 
simulated  carrier  landing  task  and  four  part- tasks.  The  results  revealed  that 
all  thr&e  attitude  parameters  were  controlled  with  a  high  degree  of  accuracy  under 
all  conditions.  Control  of  vertical  and  .lateral  position  in  the  full-scale 
simulation  condition  was  accomplished  with  about  the  same  accuracy  and  precision 
as  that  reported  for  actual  (day)  carrier  landings  in  F-4  aircrafts.  The  part- 
task  data  revealed  that  the  largest  contributor  to  lateral  error  was  Control 
Complexity. 

W/L  Cat  Code:  3.2 

Op.  Behav.  Code:  1.,  2., 

Primary  task  Mult,  measures  Experimental  Flight  simulator  Flight  simulator 

Flight  test 


Curry,  R.E.  Mental  load  in  monitoring  tasks.  In  N.  Moray  (Ed.)  Mental 
workload:  its  tneory  and  measurement .  New  York:  Plenum  Press,  1979, 

117-124. 

This  paper  describes  issues  Involved  in  defining,  predicting,  and  measuring 
mental  workload.  Concepco  presented  include  dividing  workload  into  task  demands, 
effort,  and  performance  Coals  of  measurement  and  current  methods  used  are 
r  eviewed . 

W/L  Cat.  Code:  1.,  2.2,  3.1,  3.3 

Benav.  Code:  1.,  2.,  3. 

Opinion  Multiple  Review  None  Flight  simulator 

Spare  m.  caper  Lty  Construct  Flight  test 

Primary  task 
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CY-Z7R-80 


Curry,  R.  E.,  Kleiooum,  D.  L. ,  and  Hoffman,  W.  C.  A-  design  procedure . for  cpntro/ 
display  syateae.  Hunan  Facto:!.  1977,  19,  421*436. 

This  paper  proposes  a  design  procedure  for  control  and  display  systems  in  which 
levels  of  automation  vary  over  a  significant  range.  The  sleztsnts  of  ihe  primary 
analysis  tool  are  briefly  reviewed,  and  the  uoa  of  the  model  at  three  levels  of 
specification  (information  level,  display-element  level,  and  display- format  level) 

Is  discussed.  Based  on  observation  and  pilot  commentary,  It  is  assumed  that  thu 
pilot  allocates  his  attention  to  control  the  aircraft  to  the  desired  level  of 
performance,  and  then,  with  remaining  capacity,  to  monitor  displays.  The  design 
procedure  Is  applied  to  the  longitudinal  control  of  a  CH-47  helicopter.  The 
procedure  points  out  the  need  for  performance -work load  relations  for  control, 
which  are  fairly  well  understood,  and  Ferformance-wotkload  relations  for  monitoring, 
about  which  little  is  known. 

W/L  Cat.  Code:  1.1,  3.1,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Construct  Flight  simulator  Flight  simulator 

Primary  task  Single  measures  Experimental 

Math,  model 


Dahm.j  A.  E.  Study  of  the  field  use  of  the  psychological  stress  evaluator. 
Dektor  Counterintelligence  nnd  Security,  Inc.,  Springfield,  Virginia, 
Unpublished  manuscript,  1974. 

This  paper  summarizes  the  results  of  a  questionnaire  sent  to  153  users  of 
the  Psychological  Stress  Evaluator  (PSE).  Forty-six  users  responded  to  the 
questionnaire.  The  users  were  categorized  into  four  groups?  (1)  privately 
employed  individuals  or  firms  conducting  investigations  on  a  hired  basis, 

(2)  law  enforcement  agencies,  (3)  retail/industrial  firme,  and  (4)  clinics 
and  research  individuals  or  firms.  The  results  of  the  ten  questions  contained 
in  the  questionnaire  are  individually  reported. 

W/L  Cat.  Code:  4.3 

Op.  Behav.  Code:  2.,  3. 

Physiological  Speech  patt.  Review  None  Background 

anal. 
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Damos,  D.  Res.vdual  attention  as  a  predictor  of  pilot  performance.  Human 
Factors ,  1978,  20,  435-440, 

Sixteen  student  pilots  performed  a  task  combination  designed  to  measure  residual 
attention.  Scores  on  this  combination  were  correlated  with  performances  on  flight 
checks  administered  periodically  during  flight  training.  The  multiple  correlation 
between  performances  on  the  flight  checks  and  the  task  combination  Increased  as 
the  students  progressed  through  flight  training.  The  usefulness  of  residual 
attention  as  a  predictor  of  pilot  performance  is  discussed. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  1,2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 


Damon,  D.  and  Wickens,  C.  A  quasi-linear  control  theory  analysis  of  timesharing 
skills.  Proceedings  of  the  13th  Annual  NASA-University  Conference  on  Manual 
Control,  Massachusetts  Institute  of  Technology,  June  15-17,  1977,  35  43. 

Human  involvement  with  complex  systems  often  requires  the  operator  to  tlmeshare 
or  perform  several  tasks  concurrently.  While  it  is  apparent  that  performance 
under  wiitiple-  or  dual-task  conditions  often  benefits  dramatically  from  practice, 
the  precise  sources  of  improvement  are  not  clear.  Or.e  possible  source  is  further 
mastery  of  the  single-task  skills  themselves.  A  second  possible  source  is  time- 
s Lacing  skills,  which  are  hypothesized  to  contribute  only  to  multiple-task 
performance  and  which  do  not  develop  under  single-task  conditions.  To  date,  the 
Identity,  development,  and  generality  of  timesharing  skills  have  not  been  clearly 
isolated  experimentally.  Tne  present  study  examines  performance  with  practice 
on  two  dual-task  combinations  —  dua1  axis  tracking  and  two  discrete  information 
processing  tasks  —  in  an  effort  to  identify  the  presence  and  development  of 
specific  timesharing  skills,  such  as  parallel  information  processing  or  rapid 
i  ertask  switching.  The  generality  of  timesharing  skills  also  is  investigated 
by  examining  transfer  of  these  skills  between  the  two  qualitatively  different 
task  combinations. 

W/L  Cat.  Code:  2.2.1,  2.2.2,  3.1 

Op.  Behav.  Code:  1. ,  2.,  4. 


Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory 
Primary  task  Single  measures 


Flight  simulator 
Flight  test 
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Duos,  D.  L.  and  Wickeds,  C.  D.  Dual-task  performance  au i  the  tiick-tyyman  . 

'  lew  of  choice  reaction  cine.  Journal  of  Motor  Behavior,  1977,  9^  209-215. 

The  slope,  Intercept,  and  linearity  of  the  function  relating  RT  and  stimulus 
infomat.ion  reflect  different  aspects  of  information  processing.  This 
experiment  determined  which  aspects  of  information  processing  are  affected  by 
the  presence  of  a  secondary  task.  Subject*  (n-12)  performed  a  one-dimensional 
tracking  task  concurrently  with  a  choice  RT  task.  Subjects  also  performed  each 
task  singly.  Half  of  the  subjects  performed  under  dual-task  conditions  with 
adjacent  displays,  half  with  separated  displays.  For  the  adjacent  group  the 
tracking  task  had  no  reliable  effect  on  either  the  slope,  intercept,  or  linearity 
of  the  relation.  Scanning  affected  only  the  intercept  for  the  separated  group. 
Error  on  the  tracking  task  was  found  to  increase  linearly  with  increased 
processing  load  on  the  choice  RT  task  for  both  groups.  The  results  are 
interpreted  as  supporting  a  modified  single-channel  theory. 

W/L  Cat.  Coda:  2.2.1,  2.2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measure  Flight  test 


Danev,  S.,  Radreva,  R. ,  Zlatarov,  1.  Change e  in  heart  rate  variability  due  to 
informational,  physical  and  emotional  load,  in  laboratory  and  field 
condi t  ions.  Actives  Nervosa  Superior,  1975,  IJ7,  187-188. 

Results  of  these  experiments  corroborate  the  results  of  rn  earlier  experiment  by 
G.  F.  Wartna  find  S.  G.  Danev  which  showed  no  difference  in  sinus  arrhythmia 
according  to  nost  of  the  scoring  methods  in  5  experimental  conditions  (including 
physical  as  well  as  mental  components).  The  present  results  do  not  support  the 
work  of  J.  W.  Kalebeek  who  found  a  progressive  suppression  of  sinus  arrhythmia 
and  an  increase  of  heart  rate  when  subjects  went  from  res'-  to  higher  loading 
conditions. 

W/L  Cat,  Code: 

Op.  Behav.  Code: 

Primary  task 

Physiological 


3.1,  4,1.10 
1.,  2.,  4.1 

Single  measures  Experimental 

Heart  rate, 
h.r.  var. 


Laboratory 


Flight  simulator 
Flight  test 


SY-2?R-80 


Panev,  S.G.  and  Wertnn,  G.P.  Information  load  and  tima  atraaat  Soma 
psychophyaiologlcal  consequences,  TNO-Nlsuus,  1970,  25,  389-395. 

An  autcmatlsation  in  Industry  ia  progressing,  thara  axlsta  a  growing  need  for 
ohj^ctiva  maaauraa  for  tha  mental  demand a  Imposed  upon  the  worker.  Changaa  in 
pay chophytiolog leal  fvmctioning  of  tha  human  organiaa  may  be  an  indication  of  thia 
mantel  load.  Theoretical  backgrounda  and  problem*  are  diacuaaed.  In  an 
experimental  setting  the  relative  contribution  of  two  groupa  of  factors  was  studied. 
These  two  groupa  were;  emotional  (time  atreaa)  and  informational  (arithmetical 
operations) .  Tha  results  are  indicative  of  the  fact  that  changes  in  psycho- 
physiological  functioning  during  the  task  performance  are  more  attributable  to  the 
experienced  time  stress  and  tha  induced  emotional  tension  than  to  the  pure 
processing  of  information. 

W/L  Cat.  Code:  3.2,  4.2 

Op.  Behav.  Code:  2. 

Primary  task  Mult,  measurss  Experimental  Laboratory  Flight  simulator 

Physiological 


Dental,  J.  Newer  approaches  to  research  of  meucal  load.  Proceedings  of  the 
2nd  moating  of  Psychologists  from  the  tmnubiar,  Countries.  Smolenlce, 

C*e chos 1 ovek Is ,  September,  1970. ~ 

In  regard  to  the  problem  of  stress,  the  terminology  can  be  made  more  exact: 

(1)  the  term  stress  should  be  reserved  Tor  s  heavy  physiologic*!  and  psychological 
lead  whore,  for  instance,  danger  to  life  le  involved.  (2)  Situations  involving 
the  solution  of  exacting  t*»Ks  should  be  sooken  of  ae  'mental  load*,  (i)  Load 
deriving  from  current  ectivitiea  should  be  turned  'light  mental  load'.  This  paper 
deals  with  results  of  experimental  research  which  may  be  sub-hesdad  under  the 
second  group  cf  load.  It  Involves  stimulation  of  an  operator'*  activity  in  a 
chemical  company  under  normal  conditions  and  under  an  increased  mental  load. 
Correlations  of  statlctice)  significance  wsre  found  between  results  of  laboratory 
research  (simulated  panel,  various  modifications  of  Scroop's  Interference  test, 
oscillating  curve  of  attentiveness)  and  racing  of  the  operator  nt  his  workplace, 
done  bv  his  foramen 


W/L  Cat. 

Code: 

1.1,  2.2.1 

Op .  Saha 

Code: 

1.1,  l.  i.  2.  *. 

Or  inion 

Ratuis  Scale  Experimental  Laboratory 

blight  simulator 

Spare  m. 

capacity 

Subsidiary  task 
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Daniels ,  A.  T,  Crew  workload  sharing  assessment  in  all-weather,  loir- level 
strike  aircraft.  In  Problems  of  the  Cockpit  Environment.  AGAKD  Conference 
Proceedings  Mo.  55,  March,  1970,  12-1  -  12-9.  (Ab  J65  i69) . 

This  paper  describes  the  first  phase  of  an  exp  jrimental  program  undertaken 
by  the  British  Aircraft  Corporation  to  investigate  various  aspects  of  crew 
workload  and  workspace  assessment.  In  particular,  the  use  of  the  time-lapse 
filming  techniques  of  primary  task  performance  to  assist  In  the  evaluation  of 
workspace  utilisation  is  detailed.  The  results  obtained  and  the  limitations 
encountered  during  a  relatively  inexpensive  study  in  the  early  feasibility 
stages  of  an  aircraft  program,  are  discussed. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 


Defayolle,  M„ ,  Dlnand,  J.P. ,  and  Gentil,  M.T.  Averaged  evoked  potentials  in 
relation  to  attitude,  mental  load,  and  intelligence.  In  W.T,  Singleton, 

J.G.  Fox,  and  D.  Whitfield  (Eds.)  Measurement  of  man  at  work.  London: 

Taylor  and  Franci3,  1973,  81-91. 

Various  measures  of  the  state  of  arousal,  such  as  variations  in  heart  rate  and 
rhythm,  in  skin  conductance,  and  in  E.E.G.  activity,  have  been  suggested  as 
indicators  of  mental  load.  At  the  very  least,  we  can  argue  that  arousal  level 
varies  with  the  Intensity  of  mental  strain  the  subject  accepts,  and  that  is 
partly  reflects  the  working  of  some  informational  processor.  This.  is  the 
quantitative  aspect  of  mental  load.  But  no  less  important  to  explore  is  the 
qualitative  aspect,  that  is  the  nature  of  processed  Information.  Processing  of 
information,  to  be  effective,  implies  that  mental  load  is  mainly  devoted  to 
pertinent  information.  Thus,  the  notion  of  mental  load  seems  to  involve  two 
components:  on  the  one  hand,  the  level  of  excitation  of  some  hypothetical 
mental  processor,  on  the  other  hand  the  selective  value  of  the  attention  focused 
on  the  task.  This  paper  describes  the  role  of  average  evoked  potentials  (ASP) 
in  dual  task  paradlxms.  A  vector  description  of  the  dual  task  is  developed, 
and  its  relation  to  AEP  described. 

W/L  Cat.  Code:  1.1,  2.2.1,  4.1.5,  4.1.6 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Laboratory  Flight  simulator 

Spare  m.  capacity  Subsidiary  task 
Physiological  EEG 

ECP 


SY-27R-80 


nick,  A.  0.  and  Bailey,  G.  A  comparison  between  oculometei  data  and  pilot 
opinion  on  the  uaetulnaas  of  instruments  during  landing.  Rochester,  New 
York:  University  of  Rochester,  Center  for  Visual  Science,  Technical  Report 
No,  3-7S,  1976. 

A  comparison  was  made  between  an  objective  measure  of  instrument  scanning  and 
pilots'  opinions  about  how  they  used  the  instruments.  The  data  show  a  high 
degree  of  consistency  within  and  among  pilots  for  both  the  objective  measure 
and  for  the  opinion  measure.  The  data  show  much  lower  agreement  between  the 
opinions  and  actual  use. 

W/L  Cat.  Code:  1.2,  4.1.7 

Op.  Behav,  Code:  A.,  2.,  4. 

Opinion  Questionnaire  Experimental  Flight  simulator  Flight  simulator 

Physiological  Eye  movement.  Flight  test 


Dick,  A.O.,  Brown,  J.L.  and  Bailey v  G.  Statistical  evaluation  of  control 
inputs  and  eye  movements  in  the  use  of  instrument  clusters  during  aircraft 
landing.  Rochester,  New  York:  University  of  Rochester,  Center  for  Visual 
Science,  Technical  Report  4-76,  1976. 

Two  different  types  of  analyses  were  done  on  data  from  a  study  in  which  eye 
movements  and  other  variables  were  recorded  while  four  pilots  executed  landing 
sequences  in  a  Boeing  737  simulation.  Various  conditions  were  manipulated, 
including  changer  in  turbulence,  starting  position,  and  instrumentation.  Control 
inputs  were  analyzed  in  the  context  of  the  various  conditions  and  compared  against 
ratings  of  workload  obtained  using  the  Cooper-Harper  scale.  The  results  show 
clear  differences  as  a  function  of  conditions.  A  major  portion  of  the  workload 
rating  variance  could  be  predicted  by  the  number  of  control  inputs.  There  was 
also  clear  evidence  for  different  strategies  on  the  part  of  the  pilots.  Overall 
the  results  show  a  differentiation  between  control  inputs  and  eye-scanning 
behavior,  indicating  the  need  for  an  improved  definition  of  workload. 


W/L  Cat.  Code:  1.1,  3,1,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 


Opinion 
Primary  task 
Physiological 


Rating  seals  Experimental  Flight  simulator  Flight  simulator 
Single  measures  Flight  test 

Eye  movement 


SY-27R-S0 


Donnell,  M.L.  The  application  of  dads ion-analy tic  techniques  tc  the  teat  and 
evaluation  phase  of  the  acquisition  of  a  najor  air  ays  tea:  Phase  III.  McLean. 
Virginia:  Decisions  and  Designs ,  Technical  Report  PR7 9-6-91,  May,  1979. 

This  report  extends  die  developaent  and  application  of  decision-analytic  techniques 
to  assist  In  the  test  end  evaluation  of  a  najor  air  system,  the  F/A-18  Hornet 
nultioisaion  fighter/attack  aircraft.  Early  portions  of  the  study  dealt  with 
two  developments.  First  was  the  development  of  a  hierarchlal  evaluation  structure 
in  which  missions  were  decomposed  into  sets  of  specific  tasks.  Second  was  the 
developaent  of  a  rating  scale  which  Incorporated  considerations  for  both  pilot 
workload  and  system  effectiveness.  The  F/A-18  Pilot  Task  Inventory  was  modified 
to  make  it  appropriate  for  the  A-7E,  end  ratings  for  the  reduced  task  inventory 
were  gathered  from  eight  pilots.  It  is  the  exercising  of  the  computerised  evaluation 
system  on  the  A- 7  Echo  which  is  the  primary  focus  of  this  Interim  Report.  Refine¬ 
ments  in  the  evaluation  mechanism  are  also  discussed. 

W/L  Cat.  Code:  1.1,  2.1.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Construct  Flight  test  Flight  simulator 

Spare  m.  capacity  Task  comp. ,  Experimental  Flight  test 

time  assess. 


Donnell,  M.  L.  and  O'Connor,  M.  F.  The  application  of  decision  analytic 
techniques  to  the  test  and  evaluation  phase  of  the  acquisition  of  a  major 
air  system;  Phase  II.  McLean,  Virginia:  Decisions  and  Designs,  Technical 
Report  TR  78-3-25,  April,  1978. 

The  purpose  of  this  work  was  to  complete  the  development  and  Implementation 
of  a  prototype  computerized  Pilot  Task  Inventory,  appropriately  structured 
and  applied  to  the  fighter  version  of  the  F18  aircraft.  In  doing  so,  a 
general  methodology  applicable  to  other  system  acquisition  problems  was 
developed.  The  two  major  problems  involved  in  such  an  effort  are:  (1) 
development  of  a  valid,  complete,  computerized  inventory,  appropriately 
structured  and  readily  usable  by  test  pilots;  and  (2)  development  of  a 
valid  rating  scale  for  use  in  rating  the  air  system  with  respect  to 
suitability  for  task  accomplishment. 

W/L  Cat.  Code:  1.1,  2.11 

Op.  behav.  Code:  1.,  2.,  3.,  4, 

Opinion  Rating  scale  Construct  Flight  test  Flight  simulator 

Spare  m.  Task  comp..  Flight  test 

capacity  time  assess. 
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Dttaghatty,  D.J.,  Barney,  J.B.  and  Curtin,  J.6.  Comparison  of  parcaptual 

WQ?klpad  la  flying  standard  ins  trumaatat Ion  and  the  contact  analog  vortical 
display.  Waahlvgton,  D.G. :  Joint  Amy  Navy  Aircraft  Z ns tr umantat ion  Research, 
D228-4 21-019,  December,  1964.  (Boll  Helicopter  Co.,  Fort  Worth,  Taxes.) 

Two  instrument  panels  aro  compared  (tha  JANAXR  vortical  display  and  tha  standard 
instrumant  flight  display)  in  tana  of  the  amount  of  visual  free  tine  Which  vas 
available  when  performance  using  those  two  displays  was  equal.  Tha  task  was 
performed  in  the  JAMAIR  dynamic  flight  simulator.  Pilots  wore  required  to  fly  a 
straight  and  level  course  maintaining  altitude,  heading,  track  and  airspeed.  A 
forcing  function  introduced  a  rough  sir  component  to  this  task.  Performance  on 
both  displays  was  equated  in  a  testing  period.  The  subjects  were  chan  tested  to 
determine  their  free  visual  time.  This  vaa  achieved  by  introducing  a  secondary 
visual  task  which  required  an  oral  reading  of  numbers.  These  vara  presented  at 
rates  varying  from  zero  to  two  per  second.  Results  indicated  that  the  pictorial 
JANA1R  display  was  by  far  the  auperlor  display  as  the  visual  work  load  increased. 
This  was  reflected  in  the  decrement  of  performance  on  the  primary  flight  or  visual 
task. 

V/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.t  4. 

Spare  b.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Drenncn,  T.G. ,  Curtin,  J  G.  and  Warner,  H.D.  Manual  control  in  target  tracking 
tasks  as  a  function  of  control  type,  task  loading,  and  vibration.  St.  Louis, 
Missouri:  McDonnell  Douglas  Corporation,  MDCE  1713,  August,  1977. 

An  investigation  was  conducted  on  the  use  of  fingertip  tracking  controls  which 
were  integrated  into  an  aircraft  throttle  grip  under  different  levels  of  task 
loading  and  vibration.  The  experimental  variables  Included  two  types  of  control 
(force  and  displacement),  two  levels  of  task  loading  (low  and  high)  and  four 
levels  of  vibration  (static,  moderate  and  heavy  turbulence  and  braodband) .  The 
low  task  loading  condition  required  the  pilots  only  to  track  the  displayed 
targets  or  to  fly  the  simulated  aircraft,  while  the  high  ta' *.  loading  condition 
required  simultaneous  target  tracking  and  aircraft  attitude  and  airspeed  control, 
in  the  evaluation  16  pilots  performed  the  target  tracking  and  aircraft  control 
tasks  in  a  motion  base  simulator.  Significant  differences  between  the  control 
types  were  obtained  fer  only  two  measures;  time-on- target  and  airspeed  scores. 

The  force  control  provided  significantly  better  tracking  performance  than  the 
displacement  control  as  indicated  by  the  percent  time-on- target  scores. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Mult,  measures  Experimental  Flight  simulator  Flight  simulator 

Flight  test 
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This  la  a  brief  report  of  a  Halted  simulation  experiment  intended  to  teat  the 
feasibility  of  a  tactile  display.  It  had  two  objectives:  to  determine  whether 
the  Captive  measurement  procedure  could  be  uaed  to  evaluate  novel  dlaplay  devices 
in  tactical  operations;  mid  to  deteralne  Whether  a  tactile  dlaplay  could  provide 
useful  reductions  in  visual  workload  In  tactical  helicopter  operations.  To 
estimate  the  effect  of  the  tactile  dlaplay  on  visual  workload  a  visual  secondary 
task  was  employed  as  the  dependent  variable.  As  before ,  the  adaptive  circuits 
caaputed  priisary  task  performance  and  provided  e  weighted  sun  of  error  scores. 

But  the  output  was  not  used  to  altar  the  vehicle  handling  qualities  and  no  tlae 
delays  were  applied.  Instead,  the  adaptive  aeasureeent  procedure  wee  used  to 
alter  the  difficulty  of  e  secondary  task  by  turning  the  teak  on  and  off.  As  sight 
be  expected,  the  basic  flight  task  proved  to  be  very  difficult  with  the  narrow 
field  of  view  visual  display  and  no  notion  cues.  It  is  important  to  note,  however, 

that  the  cross-adaptive  procedure  resulted  in  stable  system  performance  at  or  near 

the  error  criteria  for  all  these  subjects.  Bach  one  performed  the  task  six  times 
with  the  visual  cue  and  six  times  with  the  tactile  display. 

W/L  Cat.  Code:  2.2.4,.  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m,  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 

Primary  task  Single  measures  Flight  test 


Dyer,  R.  F.,  Matthews,  J.  J. ,  Wright,  C.  E.  and  Yudavltch,  R.  L.  Questionnaire 
construction  manual.  Fort  Hood,  Texas:  D.S.  Army  Research  Institute  for  the 
Behaviorel  and  Social  Sciences,  Field  Unit,  Technical  Report  P-77-1,  July,  1976. 

This  manual  has  been  prepared  primarily  fer  the  use  and  guidance  of  th.se  who 
are  asked  to  develop  or  administer  questionnaires  as  part  of  Amy  field  tests 
and  evaluations.  The  general  content  and  concepts,  however,  should  be  useful 
to  anyone  Involved  in  constructing  or  administering  surveys,  interviews,  or 
questionnaires.  Chapters  2-10  present  guidance  on  preparing,  assend>ling,  and 
arranging  items  in  questionnaires.  Chapter  11  discusses  the  importance  of 
and  procedures  for  pretesting,  and  Chapter  12  gives  respondent  characteristics 
that  Influence  questionnaire  results.  Chapter  13  deals  briefly  with  analysis 
and  evaluation  of  responses,  and  Chapter  14  discusses  interview  presentation. 

W/L  Cat.  Code:  1.1,  1.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Review  Field  Flight  simulator 

Interview  Flight  test 

Questionnaire 
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Bdaou,  ».  K.  The  Daktor  psychological  stress  evaluator  (voice  etreaa  analyser)  ( 
an  a  research  instrument.  Unpublished  neater* a  thesis.  National  Graduate 
University,  April,  1976. 

This  document  reviews  the  actual  and  potential  applications  of  the  voice  ntrrss 
analyser  as  a  research  instrument.  The  document  is  intended  to  provide  the 
potential  user  with  information  that  will  enable  him  to  understand  its 
capdbllltier ,  its  limitations,  and  its  suitability  to  his  particular  research 
needs.  Considerable  attention  has  been  given  to  deception  detection,  because 
this  has  bsen  the  primary  area  of  application  thus  far. 

W/L  Cat.  Code:  4.3 


Op.  Behav.  Code:  2.,  3. 

Physiological  Speech  patt. 

anal. 


Review  None  Plight  simulator 

Flight  test 


Edwards,  L.  R. ,  Pilette,  S.  S.,  Biggs,  B.E.,  and  Martlnek,  H.  The  effect  of 
workload  on  performance  of  operators  monitoring  unattended  ground  sensors. 
Alexandria,  Virginia:  U.S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences,  Technical  Paper  321,  September,  1S78.  (AD  AC61  694). 

The  purpose  of  this  research  project  was  to  investigate  the  effect  of  workload  on 
operator  performance  as  defined  by  target  activity  level  and  number  of  unattended 
ground  sensors  (UGS)  used.  Following  an  orientation  and  training  session, 
experienced  UGS  operators  monitored,  in  sequence,  each  of  three  event  recorder 
displays  showing  activations  of  UGS  used  in  grids.  Operators  reported  each  target 
they  detected  and  estimated  speed  and  direction  of  movement.  The  number  of  sensors 
monitored  and  the  target  activity  level  significantly  affects  UGS  operator  per¬ 
formance.  The  operators'  ability  to  detect  targets  decreased  as  either  activity 
level  of  number  of  sensors  increased.  Operators'  ability  to  estimate  target 
direction  also  decreased  as  activity  level  Increased. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4.1 

Primary  task  Single  measures  Experimental  Simulator  Background 


SY-17R-6G 


Sgeth,  B.  B.  Perception  end  attention.  Baltimore,  Maryland:  The  John*  Hopkins 
’  University,  Department  of  Psychology  Report' No.  6l,  August,  1975.  (AD  A014  215). 

The  purpose  of  this  paper  is  to  provide  the  reader  with  au  up-to-date  account  of 
the  empirical  and  theoretical  status  of  the  concept  of  attention.  The  eapbesls 
in  this  reviser  is  on  the  properties  of  attention  that  are  eanifested  in  studies 
of  human  perceptual  processes. 

W/L  Cat.  Code:  2. 

Op.  Behav.  Code:  1.,  2. 

Spare  m.  capacity  Multiple  Review  None  Background 

Construct 


Elkin,  P.  A.,  Itlochkov,  A.  M.,  and  Zhelesnlakov ,  V.  D.  Application  of  KEG  spectral 
characteristics  and  derivatives  In  aviation  physiology  practices.  Zhurnal 
Vysshei  Nervnoi  Deiatel'Nosti.  1971,  21,  560-565.  (In  Russian  ). 

In  this  paper  BEG  and  derivative  spectral  characteristics  are  evaluated  in  an 
effort  to  determine  pilot  mental  activity  during  flight.  (Paper  was  not 
obtained  in  time  to  allow  abstracting.) 

W/L  Cat.  Code:  4.1.5 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  EEG  Experimental  Flight  test  Flight  simulator 

Flight  test 


J 
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Bills,  0.  A.  Subjective  asaaasmsnt.  In  A.  H.  Roscos  (Ed.)  Ass— Ana  pilot 
workload.  AI»ItI>-AS-233,  February,  1978,  11-22.  (AC  A051  3*7). 

Workload  should  be  dearly  defined,  sad  the  definitions  should  bo  operacor- 
related  rather  thsr>  task-related.  The  eost  suitable  definition  coses  f roe 
Cooper  and  Saxper:  'The  integrated  physical  ana  mental  effort  required  to 
parform  a  Opacified  piloting  task".  The  bast  way  to  express  c  subjective 
assessment  is  through  a  simple  rating  scale  amplified  by  pilots'  explanatory 
comments.  Pilot  ratings  are  qu*!.ite  ive,  and  attempts  to  c object  them  to 
inappropriate  forms  of  numerical  analysis  should  bs  resisted.  Any  rating  scale 
should  be  designed  using  the  principles  employed  in  the  Cooper-Harper  rcele. 

Pilots  should  not  be  overburdened  end  should  be  asked  to  answer  only  a  strictly 
limited  number  of  questions  in  any  assessment.  Subject  pilots  should  be  carefully 
chosen.  The  best  results  will  be  obtained  by  using  experienced  evaluation  tv  it 
pilots.  Great  care  should  be  taken  with  extrapolating  the  results  of  simulator 
exercises. 

W/L  Cat.  Code:  1.. 

Op.  Behav.  Code*  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Review  None  Flight  simulator 

Questionnaire  Flic.it  test 

•l  . 

I 

Enstrom,  K.  D.  and  Rouse,  W.  B.  Telling  a  computer  how  a  human  has  allocated 
his  attention  between  control  and  monitoring  tasks.  Proceedings  of  the  12th 
Annual  NASA-Universlty  Conference  on  Kunual  Control.  University  of  Illinois, 
May,  1976,  104-123.  (NASA~Lm  X-73,  70). 

The  computer' 8  knowledge  of  how  the  human  has  allocated  his  attention  is  posed 
as  an  .Important  issue  in  the  design  of  human-computer  systems  where  the  two 
decision  makers  have  overlapping  responsibilities.  It  is  argued  that  ic  is 
Inappropriate  to  require  the  human  to  continually  tell  the  computer  how  he 
has  allocated  his  attention.  Instead,  a  computer  algorithm  employing  fading- 
memory  system  Identification  and  linear  discriminant  analysis  is  proposed  for 
real  time  detection  of  human  shifts  of  attention  in  a  control  and  monitoring 
situation.  Experimental  results  are  presented  that  validate  the  usefulness 
of  the  method. 

W/L  Cat.  Code:  2.1.1,  2.2.4,  3.3 

Op.  Behav.  Code:  1. ,  2.  ,  4. 

Spare  m.  capacity  Task  comp..  Experimental  Laboratory  Background 

Primary  task  time  assess. 

Subsidiary  task 
Math,  model 
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Boat roa,  K.  D.  <»d  Rouse,  H.  B.  Esal-tima  determination  of  how  a  huiM  hot 

allocator  hlia  attention  between  control  and  Monitoring  taaka.  MB  Yrdnaactlona 

,  1977,  SMC- 7,  153-161/ 


iTivntisrg 


A  computer  algorithm  employing  fading-memory  system  identification  and  linear 
dlacrlninant  aiulyala  la  proposed  for  raal-tlna  da taction  of  human  ahlfta  of 
attention  In  a  control  and  Monitoring  situation.  Experimental  results  are  presented 
that  validate  the  usefulness  of  the  method.  Application  of  the  method  to  computer- 
aldad  decision -making  In  multitask  situations  is  discussed. 


W/L  Cat.  Code:  2.1.1,  2.2.4,  3.1,  3.3 


Op.  Behav.  Code:  1.,  2.,  4. 


Spare  a.  capacity  Task  comp..  Experimental  Laboratory  Flight  simulator 

time  assess. 

Primary  task  Subsidiary  task 

Single  measures 
Math,  model 


Ephrath,  A.  R.  Pilot  workload  during  an  instrument  approach.  Storrs,  Connecticut: 
University  of  Connecticut,  Cyberlab,  Unpublished  manuscript. 

This  empirical  study  documents  the  changes  in  the  instantaneous  workload  of  a 
pilot  executing  an  Instrument  Landing  System  approach.  The  results  show  a  marked 
increase  in  the  pilots'  workload  (measured  by  s  subsidiary  taste)  as  distance  to 
touchdown  decreases.  This  increase  in  workload  is  present  to  different  degrees 
both  during  coupled  (automatic)  and  manually- flown  approaches. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Coda:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 

Flight  test 
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.i;  *’  glXot  _8irfpT^ftnc»  in  aero-visibility  precision  approach  (NASA 
CR-137739) .  Doctoral  dissertation,  Massachusetts  Institute  of  Technology, 
June,  1975, 

This  research  consisted  of  an  experimental  investigation  which  was  carried 
ot't  in  a  static  ground  simulator.  Fifteen  airline  pilots  flew  zero-visibility 
lending  approaches  with  different  degrees  f  autostation  and  at  different  workload 
levels  which  were  induced  by  iiaulated  w  ,  disturbances.  The  pilots'  ability 
to  detect  failures  and  to  provide  e  reliable  manual  hack-up  capability  was 
monitored  and  recorded.  To  measure  the  pilot's  workload ,  a  "warning  light" 
type  subsidiary  task  was  selected.  There  was  a  very  marked  increase  In  workload 
scores  at  altitudes  below  500  feet  AGL,  which  was  inversely  related  to  distance- 
to-go. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  1.,  4. 

Opinion  Rating  scale 

Spare  m.  capacity  Questionnaire 
Primary  task  Subsidiary  task 

Single  measures 


Ephrath,  A.  R.  A  novel  approach  to  the  cross-adaptive  auxiliary  task.  Proceedings 
of  the  12th  Annual  NASA-Universlty  Conference  on  Manual  Control .  University  of 
Illinois,  May.  1976,  03-71.  (NASA  TMX-7 3,170) . 

This  paper  presents  a  scheme  for  modulating  the  difficulty  of  a  primary  manual- 
control  task  by  means  of  an  auxiliary  task  feedback.  The  method  may  find  useful 
applications  in  operator  workload  research,  in  part-task  simulation  studies  and 
in  personnel  training.  Primary  task  difficulty  was  controlled  by  modulating  the 
noise  content  of  the  forcing  function,  and  results  suggest  that  a  stable  work¬ 
load  level  may  be  achieved  by  proper  selection  of  the  subsidiary  task  to  be  used 
and  by  proper  design  of  the  adaptive  logic.  Other  methods  of  controlling  the 
primary  task's  difficulty  -  such  as  changing  display  and  control  gains  o*  varying 
an  unstable  mode  -  may  perhaps  also  be  used.  Finally,  this  study  raised  an 
interesting  question  about  human  perception  of  the  correlation  between  control 
inputs  and  the  output,  its  dependence  on  the  dynamics  of  the  plant  and  the  effects 
of  the  associated  time  lags.  While  this  question  is  basic  to  the  study  of  human 
performance  in  manual  control  tasks  in  areas  such  as  system  identification, 
adaptation  and  fault  detection,  it  has  never  been  addressed  explicitly,  to  our 
knowledge. 

W/L  Cat.  Code:  2.2.5,  3.1,  3.3 

Op .  Behav .  Code :  1 . ,  2 . ,  4 . 

Spare  m.  capacity  Subsidiary  task  Construct  Flight  simulator  Flight  simulator 
Primary  task  Single  measures  Experimental 


Experimental  Flight  simulator  Flight  simulator 

Flight  test 
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Ephrath,  A.  R.  and  Cutty,  R.  1.  Da tact Ion  by  pilots  of  syatan  fa 11 ur at  during 
-  instrument  landings.  'IBjBt  Traaaac Clone  on  Systems,  Man,  and  Cyberaatlc*. 

1977 ,  SMC- 7.  641-848. 

The  affects  of  gust  disturbances  and  the  pilot's  participation  node  In  the  control 
taak  on  hia  workload  level  and  failure  detection  performance  during  a  simulated 
low  visibility  landing  approach  are  examined.  It  was  found  that  the  participation 
mode  had  a  strong  affect  on  the  pilot'o  workload,  the  Induced  workload  being  lowest 
when  the  pilot  acted  aa  a  monitoring  elemant  during  a  coupled  approach  and  highest 
when  the  pilot  was  an  active  element  in  the  control  loop.  The  effects  of  differential 
workload  and  participation  mode  on  failure  detection  were  separated.  The 
participation  mode  was  shown  to  have  a  dominant  effect  on  the  failure  detection 
performance,  with  a  failure  in  a  monitored  (coupled)  axis  being  detected 
significantly  faster  than  a  comparable  failure  in  a  manually  controlled  axis. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 


Ettenja,  J.  H.  Blood  pressure  changes  during  mental  load  experiments  lr  man. 
Psychotherapy  and  Paychoaomatlca .  1969,  1.7,  191-195. 

Several  experiments  are  discussed  showing  an  Increase  in  systolic  and  diastolic 
blood  pressure  as  a  function  of  the  amount  of  information  handling  per  time  unit. 
In  short-term  experiments ,  this  rise  in  blood  pressure  la  not  very  impressive 
and  remains  within  the  normal  physiological  range.  There  are  aoate  indications, 
however,  that  prolonged  intensive  mental  load  Induces  a  more  important  Increase 
in  blood  pressure.  Increase  in  blood  pressure,  together  with  changes  In  other 
physiological  phenomena  such  as  haart  rate,  sinus  arrhythmia,  etc..  Indicate 
that  mental  load  may  alter  the  level  of  activity  of  the  autonomic  nervous  system. 
In  the  experiments,  an  auditory  binary  choice  taak  (high  or  low  tone  in  random 
sequeuce  and  of  differing  frequency)  was  used  to  evoke  mental  load. 


W/L  Cat.  Code:  4.1.10 

Op.  Behav.  Code:  2.,  3.,  4. 

Physiological  Blood  pressure  Experimental  Laboratory  Background 


SY-27R-BO 


Bttema,  J.H.  mi  Zielhuls ,  R.L.  Physiological  pirMtin  of  mental  load. 

Ergonomics,  1971.  I*.  137*144. 

Thu  essential  aspects  of  ehs  cams  "load"  and  "edacity",  as  used  In  work 
physiology,  dra  valid  for  mental  load  in  the  following  ways:  the  question  of  the 
physiological  "costs"  (biologioal  consequences)  of  a  given  performance;  external 
load  to  be  aaesured  In  units  of  performance /time  (signals/ time,  choices/ tine) ; 
capacity,  dependant  on  tire  of  endurance;  physiological  changes  correlating  with 
load,;  pathological  symptoms  due  to  extreme  load.  An  experiment  la  discussed, 
where  a  simple  binary  choice  task  is  used  with  several  frequencies  of  signals  to 
be  answered;  thus  providing  different  loads.  Systematic  changes  were  found  in 
heart  frequency,  sinus  arrhythmia,  systolic  and  dies toll"  blood  pressure,  rate 
of  respiration,  and  so  on.  Arguments  era  put  forward  that  these  changes  are  due 
to  a  simultaneous  rise  In  sympathetic  and  in  vagal  tone. 


W/L  Cat.  Code: 
Op  Behev.  Code: 

Primary  task 
Physiological 


3.1,  4.1.10,  4.1.11 
1.,  2.,  4. 

Single  measures  Experimental  Laboratory  Flight  simulator 
Heart  rate, 
h . r .  var . 

Breathing  anal. 


Farber,  E.  and  Gallagher,  V.  Attentlonal  demands  as  a  measure  of  the  Influence 
of  visibility  conditions  on  driving  task  difficulty.  Highway  Research  Record. 
1972,  414,  1-5. 

Six  drivers  were  required  to  negotiate  a  slalom  course  at  an  automatically 
controlled  speed  (30  or  45  mph)  while  wearing  goggles  fitted  with  various 
neutral-density  filters  and  a  motorcycle  helmet  with  a  gas  piston-operated 
translucent  face  shield.  The  face  shield  could  be  moved  from  its  normally 
occluding  position  for  a  1/2-sec  "look"  by  means  of  a  foot  switch  accessible 
to  the  driver.  Attentlonal  demand  as  measured  by  frequency  of  looks  increased 
significantly  with  increasing  goggle  density  at  both  30  and  45  mph.  The 
effect  of  the  goggles  on  attentlonal  demand  was  stronger  at  45  than  at  30  mph 
and  for  frequently  looking  than  for  infrequently  looking  subjects.  Within 
subjects  (error)  variability  was  very  low.  Other  measures  of  performance 
were  not  Influenced  by  the  goggles.  It  was  concluded  that  attentlonal  demand 
provides  a  measure  of  control  task  difficulty  or  operator  skill  to  which 
conventional  measurements  may  be  Insensitive. 

W/L  Cat.  Code:  2.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Occlusion  Experimental  Field  test  Flight  simulator 
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Allocation  pilot  models.  frocsedlnas  of  tH«  13th  BASA-Onlvaralty 
Conference  on  Manual  Control.  Maaaachusa tti  Institute  of  Technology, 
June,  19/7,  72-7». 


Th«  Northrop  urgency  decision  pilot  nodal  was  used  In  a  command  tracking 
task  to  compare  the  optimised  performance  of  multi  axis  attention  allocation 
pilot  nodal*  whose  urgency  function*  vara  1)  based  on  tracking  error  alone , 
and  2)  baaed  on  both  tracking  error  and  error  rata.  A  matrix  of  ayatem 
dynamic*  and  command  inputs  wa*  employed ,  to  create  both  symmetric  and  asymmetric 
two-axis  compensatory  tracking  tasks.  All  task*  ware  single  loop  on  each  axis. 
Analysis  showed  that  a  modal  that  allocates  control  attention  through  nonlinear 
urgency  functions  using  only  error  information  could  not  achieve  performance 
of  tha  full  modal  whose  attention  shifting  algorithm  included  both  error  and  error 
rata  terms.  Subsequent  to  this  analysis,  tracking  performance  predictions  for 
the  full  nodal  ware  verified  by  piloted  flight  simulation.  Complete  model  and 
simulation  data  are  presented. 

V/L  Cat.  Coda;  2.2.2,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  Plight  simulator  Flight  simulator 
Primary  task  Hath,  model  Experimental  Flight  test 


Fergenson,  P.  E.  and  Gold,  L.S.  Perception  of  task  difficulty.  Proceedings  of 
tha  21st  Annaul  Meeting  of  the  Human  Factors  Society,  San  Francisco, 

Claifornia,  October  17-20,  1977,  48-52. 

Twenty  male  subjects  were  shown  tha  operation  of  a  rotor-pursuit  apparatus  under 
two  states  of  three  different  task  conditions;  rotor  speed,  target  shape,  and  hand 
used.  Pre  and  post-performance  estimates  of  task  difficulty  were  obtained.  The 
results  indicated  that  subjects  had  trouble  in  estimating  the  relative  affects 
of  as  few  as  three  different  teak  variables  on  performance. 

W/L  Cat.  Code:  1.1,  3.1 


1«,  2. ,  4. 

Rating  scale  Expezimental  Laboratory  Flight  simulator 
Single  measures 


Op.  Behav.  Code: 
Opinion 
Primary  task 
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I 


I 


1 


r> 


*  ** 


SY-27R-B0 


Finkelaau,  .J.  M.  and  Glass,  0.  C.  Reappraisal  of  the  relationship  between  noise 
and  human  performance  by  means  of  a  Subsidiary  task  measure.  Journal  of 
Applied  Psychology.  1970,  54,  211-213. 

Previous  research  has  generally  shown  that  broad-band  noise  has  only  minimal 
effects  on  task  performance.  However,  this  relative  absence  of  effect  may  be 
attributable  to  the  way  in  which  earlier  Investigators  measured  performance 
decrements.  The  present  study  was  based  on  the  notion  that  where  demands 
imposed  by  the  task  and  concurrent,  environmental  stress  are  within  the  operator's 
total  information-handling  capacity,  the  task  can  be  performed  substantially 
without  errors.  For  performance  degradation  to  occur,  the  operator's  channel 
capacity  must  be  exceeded.  It  was  aosuned  that  unpredictable  nclse  in 
combination  with  multiple  task  performance  would  result  in  such  an  overload, 
whereas  the  introduction  of  nredictabie  noise  would  not  have  such  an  effect. 

A.  subsidiary  task  method  consisting  of  the  delayed  recall  of  randomly  presented 
digit:*  wat  used  to  measure  Overload.  As  expected,  the  uce  of  unpredictable, 
ns  cppc-utvi  to  predictable  nolae  resulted  in  performance  degradation  on  the 
subsidiary  ^.ask.  Performance  on  the  primary  task  was  unaffected  by  either 
type  of  noise.  These  results  were  interpreted  as  reflecting  a  reduction  iti 
spare  meWtal  capacity  as  a  function  of  the  aversivenesu  of  the  noise  stressor. 

W/T.  'flat.  Code:  -2*2.1,  3.1 

Op.  Bchav.  Code:  1.,  2.,  4. 

Sparc  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  .ftasares  Flijht  test 
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Firth,  P.  A.  Psychological  factors  influencing  the  relatroncnip  between  cardicc 
arrhythmia  and  mental  load.  Ergonomics ,  1973,  16,  5-16. 

This  paper  examines  the  development  and  use  of  eardiec  arrhythmia  as  an  index 
of  mental  workload  in  terms  of  several  issues.  These  iviclude  the  relevance  of 
autonomic  response  to  the  measurement  of  task  difficulty  and  the  implications 
of  general  principles  of  psychophysiology  cn  the  application  of  cardiac 
arrhythmia  as  an  applied  measure.  In  addition  the  complexity  of  the  psychological 
factors  which  may  influence  task  difficulty  is  discussed  with  particular  reference 
to  second-by-second  changes  in  heart  rate  variability.  In  conclusion  It  Is 
suggested  that  the  usefulness  of  global  concepts  of  task  difficulty  such  as 
mental  load  may  be  questionable,  tloreovcr  that  a  greater  understanding  ;f  what 
a  task  entails,  with  reference  to  increased  psychophysiological  knowledge,  is 
necessary  in  order  that  global  changes  In  cardiac  arrhythmia  may  be  interpreta** 
in  relation  :o  task  difficulty. 

W/L  Cat.  Coda:  4.1.10 

Op.  Behav.  Code:  1.,  2.,  h . 


I 

I 

1 


Physiological  Hiart  rate,  Review  tfonia  Flight  simulator 

h.r.  var. 
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FJ.ora,  C.  C.,  Kriechbaum,  G.  K.  L.  and  Willtch,  W.  A  flight  investigation  of 
system*  developed  for  reducing  pilot  workload  and  i  'roving  tracking  accuracy 
during  noise-abatement  landing  approaches.  Moffett  Field,  California:  National 
Aeronautics  and  Space  Administration,  Ames  Research  Center,  Contractor's  Report 
NASA  CR-1427,  1969. 

This  study  was  directed  at  evaluating  various  systems  developed  to  reduce  the 
pilot  workload  while  maintaining  tracking  accuracy  under  simulated  Instrument 
conditions  during  noise-abatement  landing  approaches.  Preliminary  results  of 
the  study  showed  that  steeper  than  normal  approaches  could  not  be  performed 
at  the  s ata  pilot  workload  level  as  a  conventional  approach  without  improvements 
in  the  path  guidance  system,  flight  instrument  displays,  and  automatic  flight 
controls.  The  results  of  further  flight  evaluations  showed  that  when  the  pilot 
was  given  an  appropriate  combination  of  system,  aids  he  was  able  to  perform  steep, 
two-beam  or  decelerating  approaches  with  workloads  and  accuracies  comparable  to 
those  of  conventional  approaches. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 


Fowler,  ft.  L, ,  Williams,  W.  E. ,  Fowler ,  M.  G.  and  Young*  D.  D.  An  investigation 
of  the  reLationabin  between  operator  performance  and  operator  panel  layout 
for  continuous  tasks.  Wright  -Pat  tersot.  A'JB,  Ohio:  Aerospace  Medical  Research 
Laboratory,  ivHRL-Tn-6S-X7G,  December,  1968. 

This  Qtudy  and  evaluated  four  principles  of  control  panel  layout:  sequence 

of  use,  functional  grouping,  optimum  location  by  frequency  of  usec  and  optimum 
location  by  importance.  The  four  principles  were  evaluated  by  factorial 
experiments  which  included  stress  conditions  and  three  levels  of  application  of 
each  of  the  arrangement  principles.  Systematic  procedures  for  applying  each 
principle  in  the  layout  process  were  developed.  Analysis  of  the  final  trials 
indicated  that  when  optimised,  sequence  of  use  leads  to  consistently  superior 
performance.  Stress  disrupts  performance  on  control  panels  layed  out  on  the 
basis  of  optimum  location  by  frequency  of  use  and  on  the  basis  of  optimum  location 
by  importance  of  use,  but  njt  on  panels  where  the  layout  principles  sequence  of 
use  and  functional  grouping  were  used.  Practical  applications  of  the  date  to 
the  pace!  design  process  are  offered 

W/L  Cat:.  Code:  3.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary*  task  Mult,  measures  EExperimental  Laboratory  Background 
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Franksnhaeuser ,  M,  suid  Johansson,  G.  Task  demand  as  reflected  in  catecholamine 
excretion  and  heart  rate.  Journal  of  Human  Stress.  1976,  2,  15-23. 


Immediate  effects  and  aftereffects  of  exposure  to  a  color-word  conflict  task 
were  studied  In  two  groups  of  subjects,  one  of  which  performed  the  task  without 
auditory  interference  ("single  conflict") ,  the  other  with  auditory  interference 
("double  conflict").  Physiological  arousal  indices  were  more  susceptible  than 
performance  measures  to  the  level  of  task  demand.  Thus,  the  higher  demand  imposed 
by  the  double-conflict  task  was  reflected  in  relatively  larger  increases  of 
adrenaline  excretion  and  neart  rate,  both  during  the  conflict  task  and  during  the 
subsequent  arithmetic  teak,  whereas  the  performance  measures  remained  unaffected. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 

Primary  task 
Ph> biological 


3  li  4.1.10,  4.1.12 
1.,  2.,  3. , 

Single  measures  Experimental 
Heart  rate, 
h.r.  var,. 

Body  fluid 
anal. 


Laboratory  Background 


Frolov,  N.  I.  Evaluation  of  the  working  capacity  of  a  pilot  during  flight  duty. 

Voenno-Meditaiuskii  Zhuvnal,  July,  1976,  54-68.  (In  Russian.) 

The  working  capacity  c.f  a  pilot  during  the  time  he  is  at  the  controls  (in  the 
presence  of  sufficient  level  of  health,  training,  and  motivation)  may  be  defined 
as  his  ability  to  perform  the  required  tasks  with  a  given  efficiency  and  proper 
tension  of  the  psychophyaiological  systems  of  the  body.  The  panel  stresses  that 
the  working  capacity  shou?  /.  be  assessed  dynamically,  based  on  a  complex  post^light 
analysis  of  the  pilot's  activities  observed  by  automatic  flight  parameter  recording 
systems,  along  with  an  Analysis  of  the  relevant  changes  In  the  physiological 
functions  of  the  pilot's  body.  Attention  should  be  directed  to  the  evaluation 
of  the  pilot's  "attention  potentiality"  and  to  the  structure  of  his  control 
movements  through  the  use  of  the  stabiliser  and  manual  controls. 


W/L  Cat.  Code: 

3.1,  3.2*  4.2 

Op.  Behav.  Code: 

1. ,  2 . ,  3. ,  4. 

Primary  tack 

Mult,  measures  Construct 

None 

Flight  simulator 

Physiological 

flight  teat 
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Tviihexm,  0.,  Sakursl ,  I.,  and  Eskimo to,  T.  MwesuYsmsnts  of  pilot  workload  during 
low  altitude  and  high  spaed  bans  users  of  P-1  imptrsonlc  Jmt  fighter*  Tachlkawa, 
Japan:  Japan  Air  Self-Defen»e  Force ,  Aaromsdical  Laboratory  Reports.  1978. 

19,  101-113.  (In  Jape ness.)  * 

In  a  a tv  ly  designed  to  reveal  the  relationships  between  the  eental  vorkload  of 
F-l  Jet  fighter  pilots  and  flight  altitude,  fou-  pilots  flew  four  different 
altitude  flights  (5000,  2000,  1000,  and  500  ft),  performing  the  name  Mission 
with  the  same  flight  patterns.  Changes  in  heart  and  voice  r.haracterla tics  of  the 
vibration-space  shift  rate  (VS3B)  were  measured.  The  heart  rate  was  found  to 
Increase  as  the  flight  altitude  decreased.  The  heart  rate  showed  mission-dependent 
behavior ,  and  In  the  case  of  the  easiest  mission  the  increase  in  heart  rate  as 
altitude  decreases  is  minimal.  The  analysis  of  VSSR  showed  that  the  eraotlonal 
state  during  flight  maneuver  had  no  significant  differences  at  the  three  higher 
altitudes,  but  at  500  ft  tho  p*,yehophy Biological  tension  increased  greatly. 

W/L  Cat.  Codes  4.1.10,  4.3 
Op.  Behav.  Coder  1.,  2.,  3.,  4. 

Physiological  Heart  rate.  Experimental  Flight  test  Flight  simulator 

h.r.  var. 

Speech  patt.  Flight  teat 

anal. 


Gabriel,  R.  F. ,  and  Burrows,  A.  A.  Improving  time-sharing  performance  of 
pilots  through  training.  Huma  Factors,  1968,  10.  53—40. 

Even  with  special  display  devices  in  gestation,  a  pilot  must  satisfy  his 
complete  visual  information  needs  by  "time-sharing"  between  the  lntra-  and 
extra-cockpit  data  sources.  A  sample  of  sixty  military  attack  pilots, 
selected  with  the  variable  of  flying  experience  in  view,  wes  divided  into 
control  and  trainee  groups.  Using  simple,  generalised  but  adaptive  simulation 
devices,  the  trainee  group  was  trained  over  an  sight-weak  period  in  display 
reading  and  in  hazard  detection.  A  comparison  of  the  trainee  group  with  the 
control  group  In  a  highly  specific  and  complex  simulated  flying  task,  showed 
that  hazard  detection  (such  as  collision)  was  Improved  significantly  without 
in  any  way  compromising  other  flying  tasks. 

W/L  Cat.  Cede:  2.2.1 

Op.  Bahav.  Code;  4.2 

Spare  m.  capacity  Subsidiary  task  Experimental  Simulator  Flight  simulator 
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Gale,  A. ,  Davies,  R.,  and  Gmallbooa,  A.  KBO  correlates  of  signal  rata,  tlma 

la  tank  add  Individual  dif fstencaa  in  reaction  tint  during  a  five-stage  suatainad 
attention  tank,  Ereonomica.  1*77,  jgg,  363-376. 

Hm  EEC  of  20  sob j  acta  was  aonitorad  continuously  while  they  performed  a  suatainad 
attention  task  In  which  aach  subject  performed  five  conditions  in  different  order. 
All  conditions  involved  regular  presentation  of  digits  (stimuli).  Subjects  were 
required  to  respond  to  particular  digits  (eipsals)  and  signal  ratios  verier  between 
10  and  SOX  over  the  five  conditions,  the  Results  worst  1.  Mssn  reaction  tine  to 
wanted  signals  Increased  following  the  first  condition  (independent  of  signal  ratio) 
and  wee  also  longest  for  the  SOX  signal  ratio  condition  (Independent  of  order  of 
permutation),.  2.  Errors  (false  positives  end  nibses)  increased  ee  a  function  of 
signal  ratio  but  not  as  a  function  of  order  of  presentation.  Subjects  with  faster 
ween  reaction  tki*a  c omitted  note  errors.  3.  KEG  abundance  for  the  lower  aaasured 
alpha  frequencies  increased  as  the  teak  progressed,  and  man  doninant  alpha  fre¬ 
quency,  decreased.  4.  KEG  abundance  for  tha  higher  neaaured  alpha  frequencies 
increased  as  s  function  of  signal  ratio  i.e.  the  higher  the  ratio,  tha  higher  the 
abundance.  5.  Subjects  with  higher  KXG  abundance  and  lower  naan  dominant  alpha 
frequency  were  fester  (naan  RT)  than  subject a  with  lover  abundance  and  higher  men 
dominant  alpha  frequency.  6.  KEG  trends  were  different  for  fast  and  alow  sub j acta; 
fast  subjects  gave  KEG  effects  for  both  signal  ratio  end  tine  in  task,  whereas 
alow  subjects  she. id  only  clue  offsets. 

W/L  Cat.  Code:  3.1,  *4.1.5 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Print- y  task  Single  measures  Experimental  Laboratory  Background 

Physiological  EEC 


Gardner,  R.  M. ,  Beltremo,  J.  S.»  and  Krinsky,  R.  Pupillary  changes  during 
encoding,  storage,  and  retrieval  of  ic formation.  Perceptual  and  Motor 
Skills.  1*75,  4£,  *51-955. 

Six  subjects  were  each  auditorily  presented  six  lists  of  7-diglt  numbers  for 
retention  intervals  of  0,  5,  and  10  sec.  Pupil  else  wee  recorded  during 
stimulus  presentation,  retention  Interval,  and  recall  of  items.  Results 
Indicated  that  pupil  dilation  occurred  during  encoding  and  retrieval  of 
stimulus  items.  Pupillary  constriction  wan  found  during  the  retention 
interval  whan  rehearsal  was  presumed  to  occur. 

W/L  Cat.  Code:  4.1.8 

Op.  Behav.  Code:  1.1,  2.,  3. 

Physiological  Pupillary  die.  Experimental  Laboratory  Plight  simulator 
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Gartnar ,  W.  B.  and  Murphy,  H.  R.  Pilot  workload  aqd  fatlgua:  A  critical 
survey  of  concapta  and  assessment  techniques.  Moffett  Plaid,  California: 
national  Aaronautlcal  and  Spaca  Administration  Ames  Raaaarch  Canter,  NASA 
TN  D-8365,  November,  1976. 

This  wtudy  addresses  the  principal  unraaolvad  laaues  in  conceptualising  and 
Manuring  pilot  workload  and  fatlgua.  Thaaa  issues  are  seen  aa  limiting 
the  development  of  more  useful  working  concepts  and  techniques  and  their 
application  to  systaM  engineering  and  management  activities.  A  conceptual 
analysis  of  pilot  workload  and  fatigue  ,  an  overview  and  critique  of  approaches 
to  the  assessment  of  these  ohcnoMna,  and  a  discussion  of  current  trends  in 
the  management  of  unwanted  workload  and  fatigue  effects  are  presented. 
Refinements  and  in  (novations  in  assessment  methods  are  recoemended  for 
enhancing  the  practical  significance  of  workload  and  fatigue  studies. 

W/L  Cat.  Code:  1. >  2. ,  3. ,  4. 

Op.  Behav.  Code:  1.,  2.,  3. 


Opinion  Multiple 

Review 

None 

Flight  simulator 

Spare  m.  capacity 

Flight  teat 

Primary  task 

Physiological 

Gartner,  W.  B.  and  Murphy,  M.  R.  Concepts  of  workload.  In  B.  0.  Hartman  and 
R.  B.  McKenzie  (Eds.)  Survey  of  method*  to  assess  workload.  AGARD-AG-246 , 
August,  i979,  1-2. 

Pilot  workload  refers  to  how  much  a  pilot  must  do  to  perform  a  specified  flight 
operation.  Fatigue  la  widely  understood  aa  a  feeling  of  tension  or  weariness, 
often  accompanied  by  un  obvious  unwillingness  or  inability  to  continue  to  work  or 
perform.  However,  when  attempts  are  made  to  quantify  the  workload  imposed  on  a 
pilot  by  a  particular  aircraft  design,  or  operational  procedure,  or  to  excess  the 
effects  of  fatigue  upon  system  performance,  important  unresolved  issues  arise  in 
regard  to  the  more  precise  specification  of  workload  and  fatigue  concepts  and  to 
the  adequacy  of  assessment  criteria  and  techniques.  This  chapter  addresses  the 
principle  of  operator  workload  concepts,  Jahns  has  found  it  useful  to  characterize 
workload  as  "an  integrative  concept  for  evaluating  the  affects  cn  che  human  operator 
associated  with  multiple  streasea  occuring  within  man-machine  environments." 

While  broader  conceptions  may  be  considered  useful  for  Indicating  the  range  and 
diversity  of  workload  reference ,  the  purpose  her*  is  to  outline  the  principle 
ways  in  which  investigators  have  elected  to  restrict  the  use  of  ths  tarn. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiple  Construct  None  Background 

Spare  m.  capacity 
Primary  task 
Physiological 
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Gaunt,  J.C.  and  Whit*,  R.’\  Mental  workload  asaassaant,  XI,  Physiological 

correlates  of  mantel  workload:  Report  of  thr*a  preliminary  laboratory  teat*. 
St.  Louis,  Missouri:  McDonnell  Douglas  Corporation,  Report  MDC  J7G23/01, 
December,  1975. 


Describes  the  results  of  tbtee  preliminary  laboratory  tests  of  physiological 
changed  under  various  types  and  levels  of  mantel  workload.  Subjects  were  tasted 
on  two  configurations  of  a  :«ntal  workload  apparatus  in  a  multiple-task  situation 
In  which  thay  monitored  four  or  six  aing^ '-digit  light-emitting  diode  counters 
to  prevent  srrors.  Mental  workload  was  varied  by  changing  the  rates  of  the  counters. 
Repeated  readings  taken  under  e  single  workload  level  revealed  only  slight 
evidence  that  blood  pressure  increased  as  a  result  of  increased  workload.  No 
consistent  relationships  were  found  between  pulse  rate  and  mental  workload. 
Respiration  rates  were  very’  stable  across  all  levels  of  workload.  Skin  resistance 
tended  to  decrease  with  an  Increase  in  workload. 


W/L  Cat.  Code:  2.2.1,  4.1.2,  4.1.10,  4.1.11 

Op.  Behsv.  Code:  2.1,  2.2 


Spare  m.  capacity  Subsidiary  task  Experimental  laboratory 
Physiological  GSR 

Blood  pressure 
Breathing  anal. 


Flight  simulator 


Geer,  C.  W.  Navy  manager's  guide  for  the  test  and  evaluation  sections  of 
MIL-H-46855.  Seattle,  Washington:  Boeing  Aerospace  Company,  Technical 
Report  D194-10006-2 ,  June,  1977. 


Assistance  is  provided  to  HFE  Navy  managers  in  planning,  scheduling,  and 
performing  HFE  T&E  in  accordance  with  the  requirements  of  VTL-H-46835.  The 
emphasis  of  this  guide  (as  compared  to  the  user's  guide)  is  placed  ou  the 
planning  and  scheduling  necessary  to  produce  the  most  cost  effective  total 
T&E  effort.  Both  formal  and  technical  T&E  program  requirements  are  indicated. 
Basic  T&E  considerations  such  as  data  Inputs,  level  of  detail,  timing ,  and 
applications  are  described.  Types  of  HFE  T&E  techniques  are  indicated  and  a 
system  for  choosing  or  evaluating  particular  techniques  is  briefly  described. 

33  techniques  are  listed  along  with  brief  descriptions  of  each.  A  fold-out 
chart,  which  integrates  much  of  ths  guide  content  into  a  Navy  manager's  program 
planning  decision  tree,  is  provided  and  may  be  used  as  a  checklist  to  assist 
him  in  his  job.  A  list  of  personnel  surveyed  to  obtain  much  of  the  guide 
materiel  is  Included  in  the  appendices. 

W/L  Cat.  Code:  1.2.1,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  3.,  4.  • 

Opinion  Multiple  Review  None  Flight  simulator 

Spare  m.  capacity  Flight  test 

Primary  task 
Physiological 


I 
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* 


•*3 

1 


SY-27R-80 


Geer,  C.W.  Baer's  guide  for  tha  teat  and  evaluation  sections  of  MIL-1 -46b55. 

Seattle,  Washington:  Boalng  Aerospace  Company,  Tachnlcal  Report  D194-10006-1 , 

Juu# ,  1977. 

Assistance  la  provldad  M  HP  anglnaara  in  planning,  achadullng,  and  performing 
H7K  T4E  in  accordanca  with  tha  requirements  of  M1L-H-46855.  All  appropriate 
aspects  of  tha  total  KFB  T&B  process  era  indicated  with  emphacle  being  givsji  to 
33  gpB  T&S  techniques  which  may  ba  used.  Details  of  technique  selection  and 
us*  are  included  along  with  technique  samples  where  appropriate.  Tha  emphasis  of 
this  guide  (a a  compared  to  tha  Navy  manager's  guide)  it  placed  on  the  HFE  evaluator's 
task  of  performing  tha  moot  cost  effective  total  T&E  effort.  Both  formal  end 
tachnlcal  T&E  program  requirements  are  xndlceted.  Basic  T&E  considerations  such 
as  data  inputs,  level  of  detail,  timing,  and  applications  are  detailed.  Types 
cf  BPS  T&E  are  indicated  and  a  system  for  evaluating  ax!  categorising  techniques 
la  presented. 


V/L  Cat.  Code:  1.,  2.1,  3.,  ■>. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Opinion  Multiple 

Ravlew 

None 

Flight  simulator 

Spare  u.  capacity 

Flight  teat 

Primary  teak 

Phytiologicel 

Gelselhart,  R. ,  Koeteeuw,  R.  1.  and  Schiffter,  R.  - .  A  study  cf  task  loading 
ueieg  a  feur-mau  crew  cu  a  KC-135  aircraft  (CIaNT  BOOM).  Wrigbt-Pattersoo 
APB,  Ohio:  Aeronautical  Systems  Division,  ASD  -TR-76- 33,  April,  1977. 

Ac  the  request  of  Strategic  Air  Command  (SAC) ,  human  factors  engineers  and 
engineering  psychologists  participated  in  this  KC-135  crew  composition  and 
task  load  analysis  entitled  GIANT  BOOM.  GIANT  BOOM,  a  follow-on  study  to 
SAC's  earlier  GIANT  CHANGE,  determined  the  feasibility  of  a  four-men  KC-135 
crew  consisting  of  two  pilots,  a  boom  operate r,  and  an  anllated  Plight  Systems 
Operator.  This  crew  complement  r  with  inertial,  navigation  system a  and  radars 
for  the  pilot?  end  Plight  Systum  Operators,  demonstrated  significantly  reduced 
teak  louder  on  both  pilote  from  those  observed  in  GIANT  CHANGE. 

W/L  Cet.  Code:  1.2,  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Questionnaire  Experimental  Flight  test  Flight  simulator 

Spare  m<  capacity  Teak  cotap . g  Flight  test 

time  assets. 
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Gelselbart,  R. ,  Srhlfflsr,  t.  J.  and  Ivey,  L.  J.  A  study  of  task  loading  using 
a  three-man  creu  on  a  RC-135  aircraft.  Wright-Pautsrson  Ohio: 

Aeronautical  Systems  Division,  ASD-TR-76-19.  Gctobar,  1976. 

A  aarlas  of  flight  tasts  was  conduct sd  to  assass  tha  feasibility  of  reducing 
the  craw  sisa  on  a  KC-135  whan  a  dual  Inertial  Navigation  Syst«»m  (INS)  was 
Installed.  -Test  crows  consisted  of  pilot,  copilot,  and  boon  operator  only. 

Crew  performance  during  air  refueling  Missions  wan  assessed  through 
questionnaires  and  Inflight  observation  of  crew  newbo  >.  Test  edacious  included 
Cell,  High  Latitude,  Coronet,  and  KWO/Mlasion  Change  sc  uarlos.  During  critical 
phases  of  the  missions,  severe  teak  overloading  resulted  in  the  deletion  or 
deferral  of  many  normal  duties. 

W/L  Ct.  Coda:  1.2,  2.1.1 

Up.  aahav.  Coda:  1.,  2.,  3.,  4. 

Opinion  Questionnaire  Experimental  Flight  test  Flight  simulator 

Spare  m.  capacity  Teak  camp.,  Fligh  v.est 

time  assear. 


GersthcwoLl,  S.J,  Definition  and  mnasurement  of  cerceptual  and  mantel  workload 
in  aircrews  and  operatorn  of  Air  Force  weapon  systems:  A  status  r^p*rt.  In 
B.O,  H#rfc«fcn  (Ed.)  Higher  Mental  Functioning  in  Operational  EnvlronaJutc . 

AGAKD  Conference  Proceedings  No.  lSl,  April,  1976,  Cl-1  -  Ci-7.  (*I>  A025  663). 


It  ia  recognised  that  every  flight  Mission  places  certain  perceptual  rd  oantsl 
demands  on  tha  pilot  nnd  tha  crew,  which  depend  ou  a  carle ty  of  variables  and 
condition*.  Moreoever,  every  mission  involves  certain  tasks,  which  are  either 
flight  oriented  or  combat  oriented.  This  classification  lends  itself  to  a 
definition  of  activities  as  primary  or  secondary  teaks,  which  hss  been  successfully 
used  in  experiments  for  quantitative  determinations  of  workload.  The  determination 
of  pilot  and  aircrew  workload  using  psychological,  physiological,  and  operational 
criteria  has  yielded  valuable  results.  Kathode  used  in  civil  aviation  can  be 
applied  with  appropriate  modifications  to  military  Problems,  However,  data  are 
not  available  from  actual  combat  missions.  The  results  obtained  by  simulation 
an  promising  and  may  be  improved  by  the  standardisation  of  methods  and  tha 
application  of  statistical  approaches  and  mathematical  modal*. 


W/L  Cat.  Coda;  2..  3.,  4. 

Op .  Behav .  Cod* :  l.,  2.,  3.,  4. 


Spare  m.  capacity  Multiple  Review 

Primary  task 

Physiological 


None 


Flight  simulator 
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Gorethewohl,  S,  J.,  *rowo;  tt.  7;*,  Burke?  J.  K.,Tlnball,  K.  A.,  Lows,  V.  F.  * 
and  Sta.khoune,  S.  F .  InfHrht  M«tui'M«rt  of  pilot  workload:  A  panel 
discussion.  Aviation!  Spat  ,  and  Environmental  Medicine.  1978.  49. 
810-922.  ~ 


A  group  of  L.S,  scientists  engaged  in  Inflight  measurements  of  pilot  workload 
discussed  the  prohieas  and  aspect*  of  workload;  the  techniques  used  for 
inflight  measurements;  the  various  workload  models!  such  as  design-oriented, 
operational,  psychological,  sad  physiological  concepts;  different  experimental 
approaches;  and  experiences,  results  and  further  plans,  during  the  48th  Annual 
Scientific  Meeting  of  the  Aerospace  Medical  Association  in  Las  Vegas,  Nv.  on 
May  10,  1977.  The  contributions  by  the  chairman  and  the  five  panel  members 
are  summarised . 

W/L  Cat.  Code:  2.1.1,  2.2.1,  4.1.7,  4.2 

Op.  Behav.  Code*  1.,  2.1,  4.2 

Spare  m.  capacity  Task  component  Review  Flight  simulator  Flight  simulator 

Physiological  Subsidiary  task  Flight  test  Flight  test 

Lye  movement 

Mult,  measures 


Gerathewoul,  S.  J. ,  Chiles.  W  D. ,  and  Thackeray,  R.  1.  Assessment  of 

perceptual  and  mental  performance  in  civil  aviation  personnel.  In  B.  0. 

Hartraon  tEo,),  Higher  Mental  Functioning  in  Operational  Environments.  AGARD 
Conference  Proceedings  Mo.  1.81,  April,  1976,  C*7.  fAb-A025  663). 

Experiments  were  conducted  to  study  functions  of  relevance  tc  * lucres,  pilot,  end 
ATC  performance.  They  concerned  the  assessment  of  usntal  functions  and  complex 
performance  on  nlugle  operators  and  five  man  crews  while  monitoring  static  and 
dynamic  processes,  of  perceptual  motor  tracking  ability,  as  well  as  group  problem 
solving.  Operator  proficiency  was  measured  at  various  levels  of  demand  induced 
by  the  eimultaneoua  performance  cf  different  combinations  of  teaks,  requiring  th* 
exercise  of  psychological  and  mental,  processes.  It  was  found  that  multiple  task 
performance  varied  significantly  a*  a  function  of  Information  input  and  group 
interaction.  Substantial  correlations  ware  obtained  between  perceptual  motor 
type  problem  solving  and  mental  ability  taste.  Moreover,  the  results  obtained 
frost  two  tracking  task*’,  suggest  that  a  central  process  exerts  e  regulatory  influence 
on  a  variety  of  physiological  variables  during  increased  attention  demand. 

W/L  Cat.  Code;  3.1,  3,2 

Up.  Bonev,  Code:  1.,  *1.,  4. 

t  .....miry  teak  Single  measures  Experimental  Laboratory  Fllgh*  simulator 

Mult,  measures  Flight  simulator 
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Gilson,  R.  D. ,  Burk*,  H.  V.,  and  Jagaclnskl,  R.  J.  Secondary  visual  workload 
capability  with  primary  visual  and  kiaas thatic- tactual  displays.  Proceed Inga 
o f  the  22nd  Annual  Meeting  of  the  Himan  Factors  Sociaty,  Detroit,  Michigan, 

1978,  293-297. 

Subjects  performed  a  cross- adaptive  tracking  task  with  a  visual  seconder*  display 
and  either  a  visual  or  a  quickened  kinesthetic- tactual  (K-T)  primary  display.  The 
quickened  K-T  display  resulted  in  superior  secondary  task  performance.  Comparisons 
of  secondary  workload  capability  w.’.th  integrated  and  separated  visual  displays 
indicated  that  the  superiority  of  the  quickened  K-T  display  was  not  simply  due  to 
the  elimination  of  visual  scanning.  Whan  subjects  did  not  have  to  perform  a 
secondary  task,  there  was  no  significant  difference  between  visual  and  quickened 
K-T  displays  in  performing  s  critical  tracking  cask. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 
Spare  m,  capacity 
Primary  task 


2.2.4,  2.2.5,  3.1 
1.,  2.,  4. 

Subs! diary  task  Experimental 
Single  measures 


Laboratory 


Background 


Glenn,  F.  A.,  Streib,  M.  I.,  and  Wherry,  R.  J. ,  Jr.  The  human  operator 
simulator  volume  VIII:  Applications  to  assessment  of  operator  loading. 
Willow  Grove,  Pennsylvania:  Analytics,  Technical  Report  1233-A,  June  1977. 

This  study  was  undertaken  as  part  of  a  continuing  series  of  studies  designed 
to  validate  the  Human  Operator  Simulator  (HOS) .  HOS  is  intended  to  be  used 
aa  a  system  evaluation  tool  that  can  be  applied  to  a  detailed  system  design 
prior  to  the  development  of  a  hardware  prototype.  Consequently,  an  assessment 
of  its  ability  to  model  operator  workload  problems  realistically  was  considered 
to  be  of  prims  importance.  The  study  was  designed  to  show  that  HOS,  a  general- 
purpose  model  of  human  performance,  can  accurately  simulate  the  kinds  of 
complex  interactions  between  competing  -ask  demands  experienced  by  a  human 
operator  performing  a  complex  mission. 

W/L  Cat.  Code:  2.1,  2.2.2,  2.3,  3.3 

Op.  Bahav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Task  comp..  Construct  None  Flight  simulator 

Primary  task  time  assess. 

Subsidiary  task 
Occlus ion 
Math,  model 
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Gobuty,  D.  I.  TADRAF:  A  computer-aided  technique  for  reducing  aircrew  task 
analysis  data.  In  ACARD  Operational  Hallcopsr  Aviation  Msdlcinm. 

AGARD-CP-255,  May,  1978,  28-1  -  28-9. 

During  tha  design  of  tha  YAH *64  advanced  attack  helicopter,  a  technique  was 
developed  for  the  computer  elded  reduction  of  aircrew  teak  analysis  data.  The 
jfcsk  Analysis  Data  Reduction  and  Analysis  Program  (TADRAP)  begins  with  the 
pro causing  of  taw  data  fro*  a  classical  task  analysis  which  was  structured  around 
a  fiva-tlnred  pyramidal  scheme  for  mission  description.  TADRAP  converts  the 
teak  analysis  data  Into  estimates  of  operator  workload  based  upon  expected  task 
completion  tine,  plus  weighted  values  representing  the  complexity  factors  of 
action  cycle,  sensory  modality,  end  task  position.  The  TADRAP  facilitates  task 
analysis  validation  end  presents  workload  date  In  tabular  fora. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  a.  capacity  Task  comp. ,  Construct  Laboratory  Flight  simulator 

time  assess. 

Experimental 


Cberres,  H.  P.  Subjective  stress  assessment  as  a  criterion  for  measuring  the 
peycholophysicel  workload  on  pilots.  Proceedings  of  the  AG/JU)  Conference  on 
Studies  on  Pilot  Workload.  AGARD-CP-217,  April,  1977,  B12-1  -  B12-8, 

The  psychophyaiologlcal  workload  Induced  by  an  acdvlty  depends  not  only  on  the 
duration  and  intensity  of  stressing  stimuli,  but  also  upon  iatra- Individual  factors 
In  the  atreseed  subject  (physical  features,  functioning  of  sensory  organs, 
vegetative  status,  and  present  state  of  health  as  a  prerequisite  to  physical 
performance;  job-related  knowledge,  abilities,  skills,  need  for  achievement, 
experience,  emotional  stress  resistance  as  psychic  and  mental  determinants  of 
strain).  The  results  obtained  by  unlng  standardized  interviews  and  questionnaires 
to  assess  thes«  psychophyslological  strain  parameters  in  217  pilots  of  various 
type  aircraft  used  by  the  German  Federal  armed  forces  ere  presented. 

W/L  Cat.  Code:  1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Laboratory  Flight  simulator 

Questionnaire 
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Coerrea,  H.  P.  Subjective  stress  assessment-*  new,  simple  method  to  determine 
pilot  workload.  Aviation.  Space,  and  Environmental  Medicine,  1977,  4l§, 

588-564. 

A  group  comprised  of  117  Jet  pilots,  41  multiple-engine  prop  pilots,  14  single- 
engine  prop  pilots,  and  43  helicopter  pilots  was  interviewed  and  asked  to  complete 
questionnaires  to  provide  subjective  assessments  of  workload.  The  pilots  placed 
the  effect  of  individual  stressors  and  the  severity  of  tension  symptoms  during 
different  type;,  of  missions  on  a  r  J.<*  of  zero  to  six.  They  wen.  then  asked  to 
respond  to  the  same  questions  frow  the  point  o'  view  of  pilots  flying  different 
types  of  aircraft.  A  combined  scoring  table  wa*  constructed.  On  a  percentage 
scale,  with  100%  assigned  to  jet  pilots,  who  had  the  highest  strain  and  workload 
sccijS,  the  relative  workload  for  Instructor  pilots  (regardless  of  aircraft  type) 
it  95%;  helicopter  pilots,  90%,  multiple-engine  prop  pilots,  75%,  and  single¬ 
engine  prop  pilots,  60%. 

W.L  Cat.  Code;  1.1,  >,.!? 

Op.  F.ehav.  Code;  1.,  <  . ,  3.,  4. 

Opinion.  Rating  scale  Experimental  Laboratory  Flight  simulator 

Questionnaire 


Outers,  K.  M.  Relation  between  pulse  rate  during  the  complex  coordination 

►r  O  *-  oauaval  ai>4  nml  rasa  is  ctiwa^  a  f  or  t*  nn^  «froaa  o*  4  .fir 

an**  lechuical  Aerospace  Reports,  Report  No.  DLR-IB- 355-75/04,  19V'.  ^In 
Gersoan. ) 


The  connection  between  physiological  activation  in  a  test  situation  and  psychological 
measures  of  effort  and  stress  was  investigated  for  33  applicants  for  flight  uavigator 
training.  The  object  of  this  work  is  to  replace  psycholgical  measures  with  strong 
subjective  components  by  objective  physiological  parameters.  Physiological 
activation  was  relate*.)  to  pulse  rate.  !«.  was  found  that  no  r  jal  correlation 
exists,  and  that  pulse  rate  changes  arc  always  ambiguous. 


W/L  Cat.  Code; 
Op.  Behav.  Code: 
Physiological 


4.1,10 

1.,  2.,  4. 

Heart  race, 
h.r.  vav. 


Experimental  Laboratory  Background 
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Goldscein,  1.  L. ,  Dorfoan,  p.  V. ,  and  Price,  A,  Speed  and  Ijad  stress  as 

determinants  of  performance  In  a  fine  sharing  task.  Human  Factors.  1978.  20. 
603-609. 

The  effects  of  speed  and  Ijad  stress  were  Investigated  in  a  task  where  operators 
responded  to  moving  visual  stimuli  that  entered  critical  zones  In  each  of  three 
visual  displays.  As  expected,  increases  in  either  speed  or  load  stress  resulted 
in  significantly  poorer  performance.  More  Importantly,  the  effects  of  speed 
stress  were  made  apparent  by  a  speed  by  load  stress  interaction.  At  the  lowest 
level  of  load  stress  where  the  operator  was  only  required  to  atteud  to  one  display, 
increases  in  speed  stress  did  not  have  any  apparent  effect.  However,  as  load 
stress  increased  to  two  displays  and  especially  tc  three  displays,  increases  In 
speed  stress  had  a  significant  negative  impact  on  performance.  Data  concerning  the 
timing  -A  these  responses  further  supported  this  analysis.  Future  generalizations 
about  the  effects  of  speed  stress  much  consider  the  level  of  load  stress  present 
in  the  task. 


h/L  Cat.  Code: 
Op.  Behav.  Code 


2.2,  3.1 
1.,  2.,  4.1 

Spare  m.  capacity  Secondary  task  Experimental 
Primary  task  Single  measures 


Laboratory  Flight  simulator 


si 
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Gofer,  F.  E.,  Eeldeman,  L.  R. ,  and  Levlno,  S.  H.  The  application  of 

biocybcrnetic  techniques  to  enhance  pilot  performance  during  tactical  missions. 
St.  Louis,  Missouri:  McDonnell  Douglas  Astronautics  Company.  MDC  E2046, 

Final  Report,  October  1,  1979, 

This  report  describes  a  novel  means  of  enhancing  can's  performance  in  highly 
complex,  crew  station  environments.  The  benefits  of  on-line  evaluation  of 
physiological  data  are  related  to  projected  mission  requirements  for  a  1990 
tactical  aircraft.  The  pilot's  effectiveness  may  be  monitored  for  fluctuations  in 
attentiveness  and  ability  to  process  information.  The  report  summarizes  research 
which  has  demonstrated  that  these  rwiarai  activities  are  manifest  in  distinct 
electrophysio logical  signals,  and  that  such  signals,  recorded  nonlnvasively  end 
unobtrusively,  can  be  analysed  and  interpreted  in  real-time. 


W/L  Cat.  Code: 

Op.  Behar.  Code: 

Spare  m,  capacity 

Physiological 


2.1.1,  4.1.5,  4.1.6,  4.1.7 
1.,  2.,  3. ,  4 - 


Task  comp., 
time  assess. 
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ECP 

Eye  movement 
Eyelid  movement 
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Gopher,  0,  Eye  movement  patterns  In  selective  listening 


Perception  and 


cu f  1973,  14,  259-  264, 
.  »• r  w  *»■ 


tasks  of  focused  attention. 


Three  experiments  are  described  in  which  eye  movements  (Has)  ware  recorded  ir. 
conjunction  with  either  monaural  of  dichotic  tasks  of  focused  attention.  Two  main 
effects  were  observed  in  the  Ems  records:  (1)  Listening  to  a-ditory  messaged 
reduced  the  occurrence  of  spontaneous  Ems.  (2)  Selective  monitoring  of  one  ear  in 
the  dichotic  task  was  accompanied  by  a  consistent  pattern  of  directional  Ems 
characterized  by  big  seconder  and  long  changes  of  eye  fixation  in  the  direction  of 
the  relevant  ear.  The  pattern  of  Eius  is  affected  by  the  following  variables?  the 
presentation  rate  of  the  auditory  intevcoation,  the  frequency  of  demands  to  switch 
orientation  between  the  ears,  and  the  competition  of  the  irrelevant  channel  in 
the  dichotic  task.  It  is  suggested  that  the  eye-movement  mechanism  is  used  in 
selective  listening  taske  as  a  general  -orientation  ic.dicaf.or,  when  the  adoption 
or  maintenance  of  a  certain  selective  set  is  difficult  and  demanding  of  effort. 

The  Fm«  response  is  part  of  a  general  orientation  pattern,  although  its  usual 
function  is  in  the  field  of  visual  perception. 


W/L  Cat.  Code:  4.1.7 

Op .  Behcv .  Code :  1 . ,  3 . 

Physiological  Eye  movement  Experimental  Laboratory  Flight  simulator 

Flight  test 


Gopher,  D.  and  Ne von s  n,  How  ia  performance  limited:  testing  the  notion  of 
central  capacity.  Haifa,  Israel:  The  Technion,  Report  No.  HE1S-78-11, 
December,  1978. 

A  two-dimenoional  pursuit  tracking  task  was  employed  In  three  experiments 
designed  to  test  three  predictions  of  a  central  capacity  approach  to  performance 
limitations  under  time-sharing  conditions.  Each  of  simultaneously  performed 
tracking  dimensions  (horizontal  and  vertical)  was  treated  as  a  separate  task  and 
manipulated  Independently.  Tracking  difficulty  on  each  dimension  and  the  relative 
emphasis  were  jointly  investigated.  Negatively  accelerated  effects  of  task 
priority  and  limited  tradeoff  between  tracking  dimensions  were  obtained  when 
frequency  and  velocity  of  target  movement  served  as  difficulty  parameters.  Direct 
linear  tradeoffs  were  observed  when  control  complexity  was  increased  by  changing 
control  dynamics.  These  results  cannot  be  easily  accommodated  within  a  strict 
central  capacity  model.  An  alternative  interpretation  which  relies  on  a  multiple 
capacity  approach  is  outlined. 

W/L  Cat.  Code:  2.2.2,  3.1 

Op.  Behav.  Code:  1. ,  2. ,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 
Primary  task  Single  measures 
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Gopher,  T>.  end  Navon.  D.  1  Can  jrou  control  your  fcontrdl  •  on  the  «f  flciencj  of 
attention  allocation  between  trucking  dimensioned  Paper  presented  at  the 
Fifteenth  Annual  Conference  on  Mar.ual  Control,  Wright  State  University, 

Dayton,  Ohio,  March,  1979. 

e  «ff4cieocv  o  9  at  tent  l'.?  allocation  between,  tracking  dimensions  was  invest!  gnced 
..j  a  two  dimenolonal  pursuit  tracking  cask  whore  each  of  the  dimensions  was  treated 
as  a  separate  Cask  and  manipulated  Independently.  Tracking  difficulty  on  each 
dimension  and  their  relative  emphasis  were  jointly  manipulated  in  a  central  com¬ 
posite  response  surface  design.  Negatively  accelerated  effects  of  task  priority 
and  limited  tradeoff  between  tracking  dimensions  wera  obtained  when  frequency  and 
velocity  of  target  movement  served  as  difficulty  parameters.  Direct  linear 
tradeoffs  were  observed  when  control  complexity  was  Increased  by  changing  control 
dynamics.  These  results  provide  strong  eviduence  of  the  ability  of  human  subjects 
to  control  their  responses  separately.  The  differential  effects  obtained  for  the 
three  difficulty  manipulations  suggest  that  the  locus  of  load  in  the  time-sharing 
performance  of  tracking  tasks  resides  primarily  in  the  response  selection  stage. 

W/L  Cat.  Code:  2.2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 

Primary  task  Single  measures 


Gopher,  D.,  Navon,  D. ,  and  Chillag,  N.  Tracking  in  two  r  intensions  as  a  function 
of  dimension  priorities  and  tracking  difficulty.  Proceedings  of  the  21st  Annual 
Meeting  of  the  Human  Factors  Soceity,  San  Francisco,  California,  Oct.  17-20, 
1977,  118-122. 

The  present  paper  develops  the  argument  that  an  effective  eva.luctior  of  performance 
under  time-sharing  conditions  requires  a  joint  manipulation  of  tasks  difficulty 
and  operator's  resources  allocation.  An  experiment  is  presented  in  which  each 
of  the  dltoensions  in  a  two  dimensional  pursuit  tracking  task  was  manipulated  and 
controlled  separately.  Single  and  dual  task  conditions  were  created  by  presenting 
one  dimension  or  two  dimensions  simultaneously.  Time-sharing  efficiency  was 
assessed  under  a  joint  manipulation  of  tracking  difficulty  on  each  dimension  and 
their  relative  priorities.  Results  are  discussed  in  terms  of  their  implications 
to  the  problem  of  measuring  capacity,  ana  their  contribution  to  the  understanding 
of  tracking  behavior. 

W/L  Cat.  Code:  3.1,  2.2.5 

Op.  Behav.  Code:  1.,  2.,  4.2 

Primary  task  Single  measures  Experimental  Laboratory  Background 

Spare  m.  capacity  Subsidiary  task 
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Gopher,  D. ,  Navon,  D.,  Chiilag,  N.  and  Do tan,  H.  Tracking  in  two  dimensions 

as  a  function  of  dimension  priorities  and  tracking  difficulty.  Haifa,  Israel: 
Tachnioa-Istfafcl  Institute  of  Technology,  The  Center  for  Industrial  Safety 
Research,  Technical  Report  AFOSR-77-2,  December,  1977. 

The  present  report  develops  the  argument  chat  a  comprehensive  assessment  of 
performance  limitations  under  time-sharing  conditions  requires  an  evaluation 
of  the  joint  effects  of  task  difficulty  and  operator’s  resources  allocation. 

An  experiment  le  oreeented  in  which  each  of  the  dimensions  tracking  task  was 
treated  as  a  separate  time-shared  task,  and  manipulated  independently.  Tracking 
accuracy  was  assessed  under  a  joint  manipulation  of  target  frequency  on  each 
dimension  and  their  relative  priorities.  The  results  showed  that  the  priority 
variable  had  the  most  robust  effect  on  performance.  However,  this  effect  was 
negatively  accelerated.  Subjects  degraded  performance  on  an  axis  when  its 
priority  was  reduced,  but  the  released  resources  could  not  be  effectively  trans¬ 
ferred  to  improve  performance  on  the  high  priority  axis. 

W/L  Cat.  Code:  2.7.2,  3.1 

Op.  Uehav.  Code:  1,,  2.,  4. 

Spare  m.  capacity  Subsidiary  tank  Experimental  Laboratory  Flight  simulator 

Primary  task  Single  measures 


Gopher,  D.  and  North,  R.  A.  Manipulating  the  conditions  of  training  in 
time-sharing  performance.  Human  Factors,  1977,  19,  683-593. 

A  one-dimensional  compensatory  tracking  task  and  a  digit-processing,  reaction 
time  task  were  combined  to  assess  three  aspects  of  training  under  time -sharing 
conditions:  (1)  manipulation  of  desired  levels  of  dual-task  performance;  (2) 
training  under  equal  and  unequal  task  priorities;  and  (3)  repeated  sequencing 
cf  a ingle /dual- task  presentations.  Six  groups  of  10  subjects  each  participated 
iu  the  experiment.  Larger  performance  improvements  under  time-sharing 
conditions  were  observed  when  desired  performance  indicators  were  computed 
relative  to  a  dual-task  rather  than  a  single-task  reference.  Training  under 
unequal  task  priorities  revealed  that  tracking  was  more  sensitive  than  the 
digit-processing  task  to  priority  differences.  Tracking  performance  continued 
to  improve  during  repeated  single-task  presentation,  whereas  digit  processing 
inproved  only  in  the  time-sharing  conditions.  These  findings  suggest  that 
improvement  on  the  tracking  task  is  In  the  specific  skill  of  tracking,  while 
digit-processing  improvement  results  from  Improved  time-sharing  ability. 

W/L  Cat.  Code:  2.2-4,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures 
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Orahaa,  D.  X.  Transport  alrplana  flight  dack  developwsnt  aurvay  and  analysis: 
Report  and  rac  o—andationa .  Hof  fat  t  Field,  California:  National  Aeronautical 
and  Specs  Adnlnist rat ion ,  NASA  CR-145  121,  January,  1977. 

This  document  reports  results  of  a  survey  and  analysis  of  current  research 
and  development  work  In  the  U.S.A.  related  to  improving  transport  airplane 
flight  deck  equipment  and  aircrew  performance.  This  survey  and  analysis 
was  performed  for  the  NASA  Langley  Research  Center's  Terminal  Configured 
Vehicle  (TCV)  program,  which  waa  established  to  study,  test,  and  evaluate 
concepts  for  more  efficient  and  more  acceptable  terminal-area  transport 
operations.  Specific  recommendations  are  made  for  future  TCV  program  work 
in  flight  deck  development,  baaed  on  survey  results.  Methods  of  workload 
analysis  that  seem  most  appropriate  for  further  development  Include  the 
oculomecer,  time-line  analysis  program,  physical  cost  evaluations  of  workload 
which  Include  measures  of  SKG,  muscle  activity,  and  respiration  rate. 

W/L  Cat.  Code:  2.1.1,  4.1.3,  4.1.7,  4.1.8,  41.19,  4.1.11,  4.2  * 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Sparc  m.  capacity  Multiple  Review  None  Flight  simulator 

Physiological 


Green,  R.  end  Flux,  R.  Auditory  communication  and  workload.  Proceedings  of 
the  AGARD  Conference  cn  Methods  to  Asssss  Workload,  AGARD-CPP-216 ,  April, 
1977,  A4-1  -  A4-8. 

I 

This  I  paper  discusses  the  general  problem  of  assessing  how  psychomotor  workload 
may  interfere  with  the  performance  of  an  auditory  communications  tauik.  Two 
experiments  are  described.  The  first  illustrates  that  an  auditory  task  from 
which  e  cumulative  response  time  measure  is  taken  is  affected  by  changee  in 
signkl  quality  and  tha  second  experiment  shows  that  the  same  auditory  task 
la  also  affected  by  e  realistic  form  of  workload  (flying  an  aircraft  simulator). 
The  implications  of  these  findings  are  discussed  both  iu  terms  of  assessing  the 
quality  required  of  a  communications  system  and  In  tezms  of  the  use  of  secondary 
tasks  in  the  assessment  of  workload. 

W/L  bat.  Code:  2.2.1,  3.1 

Op.  jBehav.  Code:  2.1,  3.,  4. 


Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory 


Flight  simulator 


Primary  task 


Single  measures 


Flight  simulator 
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Greening,  C.  P.  Analysis  of  craw/ cockpit  aodels  for  advanced  aircraft. 

China  Lake,  Californio:  Havel  Weapons  Can tar,  HWC  TP  6020,  February,  1978. 

Tha  purpose  of  thia  study  was  to  axaalna  five  active  computer  Models  of  the 
alrcrav/cockplt  ays tea,  and  to  determine  chair  relevance  to  current  and  future 
attack  aircraft.  The  aodels  were  coopered  in  teres  of  their  general  structure, 
input  requirements,  output  options,  and  their  sensitivity  to  a  vide  variety 
of  equipment,  alee ion,  and  operator  characteristics.  Th.t  aodels  reviewed  ere 
similar  in  several  iaportent  respects:  They  all  require  %  detailed  mission 
scenario  and  task  analysis  to  steer  the  simulations  a?!  require  data  on 
performance  time  and  accuracy  as  inputs;  and  all  generate  outputs  related  to 
operator  taek  load.  The  aodela  differ  widely  in  their  sena.ltlvlty  to 
elgnif leant  variables.  Recommendations  for  future  work  are  presented. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Spare  a.  capacity  Task  comp., 

time  assess. 


Review  Laboratory  Flight  simulator 

Flight  aimulator 


Gregolre,  H.G.  Is  man  the  weakest  link?  Proceedings  of  AG  ARP  Conference  on 
Methods  to  Assess  Workload,  AGARD-CPP-216,  April,  1977,  Al-l  -  Al-3. 


The  advantages  of  small  battery-powered  video  tape  analysis  during  in-flight 
operations  are  presented  with  emphasis  on  workload  relationship  t'  human 
engineering.  Of  particular  interest  are  the  differences  between  .’aircrew  debrief 
accuracy  with  vs.  without  the  videotape  utilization.  Data  were  obtained  during 
passive  acoustic  submarine  search  and  track  operations  during  actual  ASW  test 
flights.  These  data  indicated  that  during  passive  acoustic  search  and  tracking, 
individual  control  tasks  requiring  one  or  more  pushbutton  operations  were  per¬ 
formed  from  6  to  10  times  per  minute.  Display  mode  changes  occurred  at  Intervals 
of  approximately  two  minutes.  With  the  exception  of  a  few  particular  pushbutton 
Inputs,  every  individual  pushbutton  operation  mb  guided  visually.  Keying  tasks 
which  occurred  with  the  highest  frequency  were  KEYBOARD  number leal  entries. 

The  following  potential  applications  are  identified:  1)  Capability  of  real  time 
activity  recording  with  slow  time  analysis,  2)  Actual  in-flight  data  sampling, 
and  3)  Capability  for  accurate  and  detailed  time-llue  analysis  to  be  correlated 
with  human  engineering  design  limitations  of  controls  and  displays. 


W/L  Cat.  Code:  1.2,  2.1.1 

Op.  Behav.  Coue:  1,1,  2.,  4.1 

Opinion  Questionnaire  Experimental  Flight  vest  Flight  simulator 

Spare  m.  capacity  Task  comp.,  Flight  test 

time  assess. 
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iifclotd.  Procas dine  of 
Detroit,  Michigan, 


A  cecoodary  task  which  Involves  tiaa  as  t  lan  t  ion  was  us  ad  as  a  measure  of  workload 
in  a  flight  simulation  study.  Tha  results  of  the  tiaa  estimation  task  were  coapared 
with  perforaance  scores  and  subjective  workload  ratings  to  evaluate  the  adequacy 
of  the  task.  The  successes  and  failures  of  the  techniques  are  discussed. 

W/L  Cat.  Code:  1.1,  2.2.3,  3.1 

Op  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Spare  m.  capacity  Timw  sstimaticn 
Primary  task  Slngl i  measures 


Guttmann,  H.  E. ,  Easterling,  R.  G.  and  Uabster,  R.  G.  The  effects  of  flicker 
on  perforaance  as  a  function  of  task-loading.  Albuquerque,  Mew  Mexico: 

Sandla  Laboratories,  SC-TM-72  0617,  Novsmber,  1972. 

Subjects  performed  a  tracking  task  and  s  search  task  in  a  light-tight 
chamber  that  wee  arranged  to  roll  on  lta  longitudinal  axis,  and  were 
required  to  maintain  the  chanter  vertical.  The  tracking  task  was 
individually  adjusted  for  each  subject  to  impose  a  substantial  amount 
of  task-load.  During  the  experiment,  subjects  were  exposed 
to  flicker  at  rates  of  3,  7,  11,  IS,  19,  and  23  pulsas  par  second. 

At  rates  of  11  pulses  per  second  and  higher,  performance  on  the 
tracking-taek  was  markedly  degraded.  No  degradation  in  performance 
of  the  search  task  or  maintenance  of  verticallty  wee  observed. 

Degradation  of  tracking  was  greatest  when  subjects  were  engaged  in 
the  three  tasks  simultaneously,  indicating  that  task- loading  is  an 
inportant  variable  in  tha  behavioral  response  to  flicker. 

W/L  Cat.  Code:  3.1,  4.1.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measure  Experimental  Laboratory  Flight  simulator 

Physiological  FFF 


Gunning,  D.  Tims  estimation  aa  a  technique  to 


ure  w 
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Backer,  W.  Determining  tit*  psychic  vorkloadt  Pnnat  status  and  perspectives. 
Socialiet.lachs  Arboltgvlct»sPschA.f  t ,  1974,  IS,  17-2$.  (In  Serman). 

Whereas  established  concepts  and  measuring  methods  are  available  for  the 
physiological  workload,  no  such  criteria  axis*  for  asi  ssing  the  load  d»*a 
to  mental  activity.  The  author  defines  the  terms  < .ask ,  demands,  load, 
and  stress)  from  the  standpoint  of  psychic  workload  and  examine*  the 
possibilities  of  r^cetmlalng  its  affects. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiply  Construct  None  Flight  simulator 

Spara  m.  capacity  Flight  teat 

Primary  task 
Physiological 


Hacker,  U.  et.  al. *  Internal  representation  of  task  structure  and  mental  work¬ 
load:  approaches  and  methods  of  assessment.  Le  Travail  Humaln,  1977,  40, 
239-248.  (In  French). 


A  survey  is  presented  of  research  designed  to  elucidate  problems  of  mental  load 
in  industrial  work,  using  both  laboratory  experiments  and  field  studies,  and 
examining  relationships  between  the  mental  demands  of  jobs  and  changes  of  v.xious 
indices  of  performance  end  of  subjective  and  physiological  effects.  An  initial 
enunciation  of  general  principles  stresses  the  importance  of  internal  models, 
strategies  and  goals  in  the  organisation  of  work  activities.  This  followed  by 
brief  accounts  of  four  expsrlmentsl  studios.  Of  these,  one  showed  that  the  effects 
of  load  ere  multidimensional,  e  second  gave  evidence  of  shifts  of  aspiration  and 
motivation,  s  third  lllustratad  ths  value  of  adequate  internal  models  sc  a  means 
of  preventing  fatigue,  and  a  fourth  Indicated  that  job  enrichment  which  increasee 
the  mental  demands  made  by  Industrial  work  need  not  produce  undue  mental  load. 

W/L  Cat.  Code:  1.1,  3.1,  3.3,  4.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Opinion  Multiple  Review  Laboratory  Background 

Primary  task  {experimental  Field 

Physiological 


*Nauo*  of  other  authors  not  available  at  time  of  publication. 


no 
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gather.  W. ,  Plelh.  R.  8. »  Richter.  P.  and  Zism.'*  .  *.  Intetnel  representation 
of  talk  ai rue Curs  and  metal  load  of  vorki  i^protebaa  and  mstkodw  ctf 
wmmmbI.  Iraoaomlc* .  1978.  187-194. 

survey  is  presented  of  r a* torch  designed  to  elucidate  problems  of  mental 
load  is  industrial  work.  using  both  laboratory  experiments  md  field  studio* > 
and  examining  ralationabipa  batvaan  tha  mantel  demands  of  jobs  and  changes 
during  a  working  apall  of  various  iadlcaa  of  performance  and  of  aubjactive 
and  physiological  affacta.  An  initial  asunciatlon  of  ganaral  principles 
strasscs  the  lnportanca  of  internal  nodal*,  strategies  and  goals  In  tha 
organisation  of  work  activities.  This  is  followed  by  brief  accounts  of  four 
experimental  studies,  Of  thee*.  one  showed  that  tha  affacta  of  load  are 
multidimensional,  a  second  gave  evidence  of  shifts  of  aspiration  and  not  i. vat  Ion , 
a  third  illustrated  tha  value  of  adequate  internal  noiels  as  a  naans  of 
preventing  fatigue,  and  <  fourth  vindicated  that  job  enrichment  which  increases 
tha  nantal  demands  made  by  industrial  work  need  not  produce  undue  nantal  load. 

W/L  Cat.  Coda:  3.1 

Op.  Behav.  Coda:  1..  2.,  3.,  4. 

Primary  task  Singla  Measure*  Review  Laboratory  Flight  simulator 

Field 


Hagan.  J.  F.,  Hoe,  P.  J.,  and  Worntachek.  R.  ili^ht  evaluation.  MT-2  Integrated 
controller  installed  in  an  OH- 58 A  helicopter.  Sdwards  Air  Force  Base. 
California:  U.S.  Any  Aviation  Fnginaaring  Flight  Activity  77-11.  Final 
Report.  April.  1978.  (AD- A— 65  072). 


This  activity  conduced  a  handling  qualities  and  pilot  workload  evaluation  of  the 
MR  II  integrated  controller  in* tailed  in  an  0H-58A  helicopter.  The  0H-58A  could 
ba  safely  flown  throughout  tha  rocortsandeu  flight  envelops  owing  tha  Integrated 
controller.  Tha  pilot  workload  whan  using  ths  integrated  controller  with  two 
hands  wss  not  reduced  fro*  and  was  sometimes  greater  than  the  workload  when  using 
conventional  controls  for  all  maneuvers  accept  level  forward  iligth.  Singla 
hand  control  during  Iligth  and  landing  could  ba  aafaly  accomplished,  but  required 
increased  pilot  workload  in  all  casos.  TLw<  two  t*oat  aarlcua  unsatisfactory 
characteristic*  ideutlfled  were.  lack  ut  m:  adequate  ay* tarn-decoupled  warning  end 
excessive  workload  during  left  sides  vri  flight  between  approximately  15  to  25 
knots  true  airspeed. 


W/L  Cat.  Code:  l.l.  1.2,  3.1 

Op.  Bahav.  Coda:  1,.  2,  4. 


Opinion 
Primary  task 


Rating  scale  Experimental  Flight  test 

Questionnaire 

Single  measures 


Flight  »*.‘tulstor 
Flight  t^at 
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Hale,  H.  £. ,  Andcrso© ,  C.  A. ,  Williams,  E.  V.  and  Tanne,  E.  Endocrine-metabolic 
effects  of  uauauaJiy  long  or  frequent  flying  adaalona  is  C-130E  or  C-135B 
aircraft*  AstOSPSCe  Medicine,  1963,  361-370* 

Flight-straes  appraisal  wee  made  by  naaaa  of  a  battery  of  urinary  determinations 
(epinephrine,  norep icaphrins ,  17-OHCS,  urea,  uric  acid,  phosphorus,  magnesium, 
a odium,  and  potassltaO  for  flyara  who  participated  in  (a)  20-hour  alaaiona  In 
C-130K  aircraft  (flights  from  Haw  Zealand  to  Antarctica,  and  back),  (b)  6-day 
nlralona  in  3-135B  aircraft  (aarth-clrcllng  nlaalooa)  or  (c)  7-waek  missions  In 
C-I358  aircraft  (overfrequent  tranaoceanlc  and  transcontinental  flying).  The 
adrenal  madulla  (judging  by  urinary  epinephrine)  consistently  showed  flight- 
sensitivity,  hut  other  eadocrina-nstabolic  functions  varied  it'  ways  indicative 
of  awptatlon.  With  flight  cifcunmt#nee«  standardised  (particularly  with  respect 
to  tins  of  day),  flight  effects  tended  to  be  reproducible.  With  craw  rest 
limited  to  2  days,  recovery  from  fright-stress  tandad  to  be  incomplete.  Sletp- 
deprivation  end  crew  position  were  ahum  to  ha  factors  which  modify  flight-stress 
raactlona.  lastbound  and  westbound  aarth-clrcllng  missions  did  not  Indues 
different  degrees  of  f light -stress,  ac  judged  by  these  endocrine-metabolic  lndlcaa. 

W/L  Cat.  Code:  4.1.12 

Op.  Bekav.  Code:  1.,  2.,  3.,  4. 


Physiological  Body  fluid  Experimental  Plight  test 

anal. 


Flight  simulator 
Flight  rest 


Hale,  H.B.,  Hartman,  B.O.,  Harris,  D.A. ,  Williams,  E.W.,  Miranda,  R.E.  end 

Hoeenfeld,  J.M.  Time  cone  entrainment  and  flight  stressors  as  interactants. 
Aerospace  Medicine.  1972,  43,  1089-1094. 

Physiologic  responsiveness  to  flying  vaa  studied,  using  the  members  of  e  double¬ 
crew  of  e  C-141  aircraft  during  six  flights,  each  of  which  lasted  34  hours  and 
involved  hi-  or  tri-dlrsct tonal  trenmeerldien  flying.  Reaponciveoess  w*r> 
quantified  by  maana  of  endocrine-metabolic  Indices  (urinary  epinephrine, 
norepinephrine,  17-hydroxycortlcosterlods,  urea,  sodium  end  potassium) ,  using 
urine  specimens  which  were  collected  at  4-hour  intervals  during  the  flight . 
Physiologic  entrainment  wee  shown  to  be  a  factor  contributing  to  responsiveness, 
for  there  wee  hythmic  variability  which  related  to  time  of  day  at  the  crews' 
hows  base.  The  waveforms,  amplitudes,  time  relations  and  overall  levels,  however, 
did  not  agree  with  those  of  unstressed  persons.  As  Judged  by  epinephrine, 
norepinephrine  end  17-OHCS,  refractoriness  toward  flight  stressors  consistently 
developed  t  2200  hours  (Eastern  Standard  Time),  even  after  the  crew  had  crossed 
many  time  xones  (flying  either  eastward  or  westward).  These  hormones  indicated 
Jyper- responsiveness  regularly  nt  0600  hours  EST;  at  other  timer  responsiveness 
was  shown  (by  these  seme  indices)  to  be  moderate  In  grade.  Patterns  emerged  for 
the  other  Indices  as  well. 

W/L  Cat.  Code:  4  1.12 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Physiological  Body  fluit'  Experimental  Flight  test  Flight  c isolator 

anal.  Flight  east 
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Cu^.e,  B,L  Hartman.  Harris,  D.A.,  Williams,  Miranda,  H.K., 

&Hii'  .d,  J.H.  thd  b.'ith,  f  tl.  Physiologic  itmft  during  5C-hour  double- 
craw  missions  la  C-1U  aircraft.  Brooks  APB,  Taxaa:  OSAF  School  of 
Aarospaca  Medicine,  3AM-TR-71-487,  October,  1971. 

By  uee  of  a  battery  of  urinary  techniques,  the  physiologic  cose  (stress)  of 
prolonged  O'*  141  flying  o pa rations  (either  staged  or  nearly-continuoua)  :raa 
shown  to  ha  aild-to-aoderete  in  degree.  Staged  alaeloos  lasting  5  or  7  days 
tended  to  be  leas  stressful  than  double-crew  neerly-contlnuous  50 -hour  elsaione. 
the  two  extremely  different  work/rast  schedules,  namely,  4/4  and  16/16  hours. 
Induced  similar  degrees  of  physiologic  stress.  Anticipatory  stress  tended  to 
be  higher  then  the  flight  stress  that  followed.  Crew  position  was  s  contributory 
factor-  slightly  modifying  flight  and  postf light  trends.  Pre-existing  circadian 
periodicity  persisted,  although  flight  had  modifying  Influence.  Tins  of  day 
that  represented  night  at  home  were  the  times  of  highest  sensitivity  to  flight. 
Recovery  from  prolonged  nearly- continuous  flying  operation*  appears  to  require 
4-5  days,  and  it  appears  to  he  s  muleiphaslc  process,  w.  th  endocrine-metabolic 
depression  appearing  first,  after  which  there  wee  oscillation  and  final 
settling  at  the  control  level. 

W/L  Cat.  Code:  4.1.12 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Physiological  Body  fluid  Experimental  Flight  simulator  Plight  simulator 

anal.  Flight  test  Flight  test 


Hale,  H.B.,  Hartman,  B.O.,  Harris,  D.A.,  William*.  E.W.,  Miranda,  R.E  . 

Hoaenfeld,  J.M.  and  Smith,  S.K.  Fhystologi;  stress  during  50-hour  double¬ 
crew  missions  in  C-141  aircraft.  Aarospaca  Medicine.  1972,  43,  293-299. 

By  use  of  a  battery  of  urinary  techniques,  the  physiologic  cost  (stress)  of 
prolonged  C-141  flying  operations  (either  staged  or  naarly-continuoue)  wee 
shown  to  be  mild-to-moderate  lc  degree.  Staged  missions  lasting  5  or  7  deya 
tended  to  be  lees  stressful  then  double-crew  neerly-contlnuous  50-hour  missions. 
The  two  extremely  different  work/rest  schedules,  namely,  4/4  end  16/16  hours. 
Induced  similar  degrees  of  physiologic  stress.  Anticipatory  stress  tend*- 1  to 
be  higher  than  the  flight  atreae  that  follovad.  Craw  position  wee  e  contributory 
factor,  slightly  modifying  flight  end  postflight  trends.  Pre-exlstiag  circadian 
periodicity  persisted,  although  flight  had  modifying  influance.  Time  of  day 
that  repveeented  night  at  home  were  the  tinea  of  hlgheat  sensitivity  to  flight. 
Recovery  from  prolonged  neerly-cor  tinuoua  flying  operations  appears  to  require 
4-5  days,  end  it  appears  to  hi  e  aultlphaalc  process,  with  endoerlne-mataboli c 
depression  appearing  first,  after  which  there  wee  oscillation  end  final 
settling  at  the  control  level. 

W/l,  Cat.  Code:  4.1.1i 

Op.  Behev.  Code:  1.,  2.,  3.,  4. 

Physiological  Body  fluid  Experimental  Flight  simulator  Flight  simulator 

anal.  Flight  teat  Flight  test 
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Hale,  B.B.,  McNea,  R.C.,  Ellis,  J.P.,  Jr.,  Bollinger,  R. R.  and  Hartman,  B.O. 
Sadocrin-metabollc  indices  of  aircrew  workload:  An  analysis  across  acudlaa. 
Proceedings  of  the  ACATO  Conference  on  Si-eOatinn  and  Study  of  High  Workload 
Operations  AGARD-CP- 146 *  April,' 1974,  A10-1  -  AlO-O. 

Endocrine-metabolic  measures  hava  baan  uaad  in  flald  fed  laboratory  studies 
involving  different  kinds  of  ollltary  aircraft  aa  waJ]  as  uiraions  of  varying 
nature  and  length.  The  data  accumulated  in  the  ten-year  period  nave  now  been 
subjected  to  a  cross- sectional  analysis  in  an  effort  to  ascertain  the  basic 
relation  of  endocrine- metabolic  activity  to  the  workload  in  either  actual  or 
simulated  flights.  For  tka  present  purpose,  load  represents  degree  of  flight 
difficulty  multiplied  by  duration.  Difficulty  waa  baaed  upon  USAF  expert 
rankings,  end  duration  waa  based  upon  fractions  of  a  day.  Multiple  linear  re¬ 
gression  analysis  was  par formed  on  data  for  urinary  epinephrina,  norepinephrine, 
17-OHCS,  urea,  Na,  K,  and  tha  He/ K  ratio.  Tills  report  presents  the  findings 
in  the  first  phase  of  the  cross-sectional  study. 

W/L  Cat.  Code:  1.1,  4.2 

Op.  Behav.  Code:  1. ,  2.,  3.,  4. 

Opinion  Rating  scale  Review  Flight  simulator  Flight  simulator 

Physiological  Mult,  measures  Flight  test  Flight  test 


Hale,  H.B.,  McNea,  R.C.,  Ellis,  J.P.,  Jr.,  Bollinger,  R.K.  and  Har'cman,  B.O. 
Endocrine-metabolic  Indices  of  aircrew  workload:  An  analysis  across  studies. 
Brooks  AFB,  Texas:  USAF  School  of  Aerospace  Medicine,  Unpublished  report. 

During  the  past  decade  the  USAF  School  of  Aerospace  Medicine  has  conducted, 
under  either  field  or  laboratory  conditions,  studies  of  human  responses  to 
flight.  The  working  hypothesis  has  been  that  flying  operations  act  in  the 
manner  of  straseore,  eliciting  interrelated  endocrine-metabolic  responses 
which  ere  compensatory  in  nature,  tending  to  maintain  a  state  of  physiologic 
balance  (homeostasis) .  A  battery  of  urinary  determinations  was  used  to  assess 
the  physiologic  cost  in  a  wide  variety  of  circumstances,  including  flying 
operations  of  various  type's  and  durations  which  took  place  at  various  time 
of  day  and  utilised  a  variety  of  aircraft.  Statistical  evaluation  consistently 
indicated  elevation  in  physiologic  "cost”  which  apparently  related  to  (a)  type 
of  aircraft,  (b)  flight  complexity,  (c)  flight  duration,  (d)  time  of  day, 
and/or  (e)  crew  position.  Additional  factors  also  seemed  to  be  contributory, 
effecting  some  or  all  of  the  endocrine-metabolic  functions  under  study. 

W/L  Cat.  Code:  1.1,  4.1.12 

Op.  Behav.  Coda:  1.,  2.,  3. .  4. 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Physiological  Body  fluid  /light  test  Flight  test 

anal. 
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Hoi*,  H.B.,  HUUcMt  B.N.t  Smith,  B.N  ,  mod  Melon,  C.E.,  Jr.  Excretion 

pat tar n<i  of  alt  traffic  controller*.  Aaroapaca  Medicine.  1971,  42,  127-138. 

Twenty  air  traffic  controllers  at  O'Hara  Airport,  Chicago,  Ill.,  ware  studied 
dally  during  two  t-day  work  periods.  During  one  of  these  periods  they  worked 
from  1500  to  2300  hours  (evening  shift);  in  the  other  period  they  worked  from 
2400  to  06'M)  hours  (morning  shift).  Traffic  density  (workload)  was  maximal 
during  the  early  part  of  the  evening  shift,  and  it  was  minimal  during  ths 
early  part  of  the  morning  shift.  Stress  appraisal  was  made  by  means  of 
urinalysis,  using  a  battery  of  determinations  which  included  epinephrine, 
norepinephrine,  17-hyJroxycorticoetsroida,  uraa,  inorganic  phosphate,  potassium 
and  sodium.  Direct  relationship  to  workload  was  indicated  for  epinephrine, 
norephinephrlne,  urea,  potassium  and  sodium.  Urinary  catecholamines  provided 
evidence  of  aympathoadrenomsdullary  hyperactivity  during  aach  work  shift, 
with  full  reversal  in -the  'postevening'  recovery  period  end  Incomplete  reversal 
in  the  'poetmorning'  recovery  period.  Adrenocortical  hyperactivity  was  evident 
only  during  the  morning  shift,  end  it  was  late  in  onset.  Relatively  high  urea 
output  characterised  tower  work,  suggesting  high  protein  catabolism. 

W/L  Cat.  Coda:  4.1.12 

Op.  Behav,  Code:  1.,  2.,  3.,  4.1 

Physiological  Body  fluid  Experimental  Field  Flight  simulator 

anal.  Flight  test 


Hull,  T.  J.,  Passey,  G.  E.  and  Meighan,  T.  W.  Performance  of  vigilance  and 
monitoring  tasks  as  a  function  of  workload.  Wright-Par terson  AFB,  Ohio: 

Aerospace  Medical  Rasaarch  Laboratories,  AMRL-TR-65-22,  March.  1965,  (AD  615  921). 

This  study  investigated  performance  of  6  tasks.  Three  of  these  tasks  were 
passive  in  nature,  requiring  only  vigilance  or  monitoring  by  the  operator 
for  detection  of  a  critical  signal;  these  were:  auditory  vigilance,  warning- 
lights  monitoring,  and  probability  meter  monitoring.  The  other  3  tasks — 
arithmetic  computations,  target  idantification,  and  code-lock  solving — required 
more  active  attention,  and  2  of  these  tasks  (target  identifications  and  code¬ 
lock  solving)  wore  group  tasks  requiring  interactions  among  the  crewueabers . 

It  was  hypothesised  that  concurrent  presentation  of  active  and  passive  task.: 
would  have  e  detrimental  effect  on  vigilance  end  monitoring  performance.  The 
'principal  purpose  of  this  study  was  the  evaluation  of  vigilance  and  moni coring 
performance  for  3  such  teaks  with  and  without  simultaneous  presentation  of  the 
taore  active  tasks.  On  the  basic  of  results  obtained,  the  following  conclusions 
ueem  justified:  (1)  Presentation  of  vigilance  and  monitoring  tasks  concurrently 
with  tasks  requiring  more  active  attention  of  an  operator  has  a  detrimental 
effect  on  the  operator's  monitoring  performance.  (2)  The  detrimental  effects  of 
increased  teak  load  do  not  appear  to  be  long-term  in  nature,  since  removal  of  the 
additional  (active)  tasks  from  the  tank  program  invariably  resulted  in  recovery 
to  previously  attained  performance  on  the  vigilance  and  monitoring  tasks. 

W/L  Cat.  Code:  2.2.1,  2.2.2,  3.2 

Op.  Behev.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  taak  Mult,  measures  Flight  teat 
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Hamilton,  P.  Process  -art.ropy  and  cognitive  control  In  N.  Moray  (Ed.)  Mental 
workload:  Its  theory  and  measurement.  New  York:  Plenum  Press,  1979, 

289  ;.97. 

While  acknowledging  the  extreme  Imprecision  of  information  theory  formulation 
it  has  the  twin  merits  of  Incorporating  into  our  discussion  of  mental  workload: 

(1)  The  contention  that  internalized  thought  as  well  ao  the  stock  perceptual/ 
motor  skilxs  experiment  must  be  made  the  province  of  the  workload  theorist. 

(2)  Some  overdue  acknowledgement  of  the  role  of  effort,  or  intensive  processes, 
in  a  field  which  has  had  for  too  long  act  its  goal  the  portrayal  of  man  as 
computer. 

W/L  Cat.  Code:  2.1.2 

Op.  Behav.  Code:  1..  2.,  3.,  4. 

Spare  m.  capacity  Inform,  theory  Construct  None  Flight  simulator 


1 


I 


Harris,  D.A. ,  Pegram,  G.V.  and  Hartman,  B.O.  Performance  and  fatigue  in 
experimental  double-crew  transport  missions.  Aerospace  Medicine,  1971, 
42,  980-986. 


Six  experimental  transport  missions  using  a  double  crew  were  flown  in  a  C-  141 
on  routes  generating  various  combinations  of  long  and  short  legs.  Crews  allowed 
c  4/4  or  16/16  work/rest  schedule.  On-board  crew-rest  facilities  were  provided 
so  that,  the  plane  could  fly  through  the  airlift  system  without  crew  changes. 

The  flying  time  averaged  around  43  hours.  Performance  was  evaluated  by  ratings 
made  by  an  on-board  flight  examiner.  There  were  no  significant  differences  in 
flight  exarv'ner  ratings.  Subjective  fatigue  was  measured  by  a  rating  scale. 

There  were  not  significant  differences  related  to  work/rest  cycles.  There  were 
significant  differences  related  to  mission  profile  3nd  crew  position.  Sleep 
EEG's  were  recorded  on  the  two  navigators.  There  was  a  marked  reduction  In 
total  sleep  as  well  as  Stage  1-REM  and  deep  sleep. 


Vi/L  Cat.  Code: 
Op.  Behav.  Code: 


1.1,  4.1.5 


1.,  2.,  3., 


Opinion 

Physiological 


Fating  scale 
EEG 


Experimental  Flight  test 
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Harris,  R  L. .  Sr.,  Mixon,  R.  W.  Advanced  transport  operation  effects  on  pilot 
scan  patterns.  Proceedings  of  the  23rd  Annual  Meeting  of  the  Hum  Factors 
Society,  Boston,  Massachusetts,  October  19  -  November  1,  1979,  347-331. 

Long  straight -in  and  close- in,  curved,  descending  instrument  approaches  were  made 
in  NASA's  fixed-b.^se  Terminal  Configured  Vehicle  simulator.  The  pilot  either 
manually  controlled  the  simulator  cr  monitored  the  automatic  ayatea  control  of 
the  simulated  aircraft  during  the  approach.  Testa  vara  performed  with  without 
the  display  of  traffic.  Hie  restilts  indicate  that  the  pilots'  use  of  the  Electronic 
Horizontal  Situation  Indicator  (EHSI)  increased  appreciably  for  the  close-in, 
curved,  descending  approach  compared  to  the  conventional  streight-ln  approach. 

When  operating  as  a  monitor  of  the  autopilot  system,  the  pilot  scanned  more  with 
less  attention  devoted  to  the  Electronic  Attitude  Direction  Indicator  (EADI). 

The  pilots  preferred  the  manual  mode.  The  addition  of  displayed  traffic  to  the 
EHSI  increased  the  pilots'  use  of  the  EHSI.  Also,  the  pilot's  pupil  diameter 
Increased  during  the  landing  flare  indicating  a  higher  stress  level  even  though 
the  tests  were  conducted  in  a  fixed-base  simulator. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 


1.2,  4.1.7,  4.1.8 
1. ,  2. ,  4. 


Opinion 

Physiological 


Interview  Experimental  Flight  simulator  Flight  simulator 

Eye  movement  Flight  teat 

Pupillary  dia. 


Harris,  S.  D. ,  North,  R.  A.  and  Owens,  J.  M.  A  system  for  the  assessment  of 
human  performance  in  concurrent  verbal  and  manual  control  tasks.  Paper 
presented  at  the  7th  Annual  Meeting  of  the  National  Conference  on  the  Use 
of  On-Line  Computers  in  Psychology,  Washington,  D.C. ,  November  9,  1977. 

A  multi-purpose  laboratory  system  Incorporating  a  voice  Interactive  terminal 
and  graphic  display  system  is  described.  Tnt  facility  is  designed  to 
Investigate  some  aspects  of  human  performance  of  concurrent  verbal  and 
tracking  tasks.  The  results  of  a  pilot  study  showing  decrements  in  dual¬ 
task  performance  are  reported. 


W/L  Cat.  Code:  2.2.2,  3.1,  4.3 


Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 
Physiological 


1.,  2.,  3.,  4. 

Subsidiary  task  Experimental  Laboratory  Flight 

Single  measure  Construct  Flight 

Speech  patt, 
anal. 


simulator 

test 
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Hart,  S.  6.  Tine  activation  as  a  secondary  task  to  measure  workload-attention 
sharing  effect  cn  operator  performance.  Proceedings  of  the  Eleventh 
Conference  on  Manual  Control,  NASA-Anes  Research  Center,  May  21-23,  1975, 

64-77.  (NASA  THX-62,464) . 

-.1 

Variation  in  the  length  of  tine  productions  and  verbal  estimates  of  duration  was 
investigated  to  determine  the  influence  of  concurrent  activity  on  operator  time 
perception.  The  length  of  10- ,  20- ,  and  30- sec  intervals  produced  while 
perforating  six  different  compensatory  tracking  tasks  was  significantly  longer, 

232  on  the  average,  than  those  produced  while  performing  no  other  task.  Verbal 
estimates  of  session  duration,  taken  at  the  end  of  each  of  27  experimental 
sessions,  reflected  a  parallel  Increase  in  subjective  underestimation  of  the 
passage  of  time  as  the  difficulty  of  the  task  performed  increased.  These  data 
suggest  that  estimates  of  duration  made  while  performing  a  manual  control  task 
provide  stable  and  sensitive  measures  of  the  workload  imposed  by  the  primary 
task,  wi  h  minimal  Interference. 

W/L  Cat  Code:  2.2.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  cape city  Time  estimation  Experimental  Laboratory  Plight  simulation 


Kart,  S.  G.  A  cognitive  model  of  time  perception.  Paper  presented  at  the 
56th  Annual  Meeting  of  the  Western  Psychological  Association,  Los  Angeles, 
California,  April,  1976. 

Pour  methods  have  been  used  extensively  to  measure  individual's  ability  to 
estimate  or  produce  specified  Intervals  of  clock  time.  The  verbal  estimation 
method  requires  that  one  vocalize  a  judgement  of  the  duration  of  an 
operationally  presented  interval.  The  method  of  production  requires 
operational  production  of  an  interval  whose  duration  has  been  specified 
verbally.  The  method  of  reproduction  requires  the  operational  production 
of  a  standard  Interval  that  was  operationally  presented.  The  method  of 
comparison  involves  a  relative  judgement  between  the  durations  of  two 
operationally  presented  intervals.  Th  s  paper  reviews  these  methods. 

W/L  Cat.  Code:  2.2.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Time  estimation  Construct  None  Flight  simulator 

Flight  test 
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Hart,  S.  G.  Pilot  workload  during  final  approach  in  congested  airspace. 

Proceedings  of  the  1978  IEEE  Conference  on  Decision  and  Control,  San  Diego, 
California,  January  10-12,  1979,  1345-1349. 

Time  estimation  has  been  proposed  as  a  measure  of  pilot  workload  and  It  appears 
that  the  production  method  provides  a  useful  measure.  The  verbal  estimation 
method  lies  also  been  investigated  and  it  appear, i  that  it  does  not  provide  as 
sensitive  a  measure  of  workload  as  does  the  production  method.  Overestlmatlon  may 
either  reflect  boredom  during  the  interval,  or  the  fact  that  a  great  deal  of 
activity  was  performed  during  the  Interval  Ikat  was  remembered.  Underestimation 
may  either  reflect  a  feeling  that  time  passed  quickly  because  interesting 
activities  were  engaged  in,  or  that  so  little  activity  was  performed  or  remembered, 
that  vary  little  time  passes. 

W/L  Cat.  Code:  2.2.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Time  estimation  Experimental  Flight  simulator  Flight  simulator 


Hart,  S.  G.  and  McPherson,  D.  Airline  pilot  time  estimation  during  concurrent 
activity  Including  simulated  flight.  Paper  presented  at  the  47th  Annual 
Meeting  of  the  Aerospace  Medical  Association,  Bal  Harbour,  Florida,  May, 

1976. 

Human  factors  researchers  have  sought  an  unobtrusive  and  minimally  loading 
additional  task  that  is  sensitive  to  differences  In  flying  conditions  and 
aircraft  Instrumentation  associated  with  complex  piloting  tasks.  The  present 
research  was  aimed  sc  clarifying  the  functional  relationships  between  the 
length  and  variability  of  time  estimates  and  concurrent  task  variables. 

Tine  estimation  Is  an  unobtrusive  and  minimally  loading  task.  The  central 
tendency,  variability,  and  shape  of  the  distributions  of  time  productions 
provide  indices  of  concurrent  teak  processing  requirements.  Thus,  time 
estimates  may  prove  useful  to  human  factors  researchers  Interested  in 
comparing  different  con&lnatlona  of  displays  and  controln  associated  with 
complex  piloting  tasks. 

W/L  Cat.  Code:  2.2.2,  2.2.3 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Time  estimation  Experimental  Flight  rlmulator  Flight  simulator 
Primary  task  Single  measure  Flight  test 
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Start,  S.G.,  McPherson,  D. ,  Kreifeldt,  J.  and  Weeps,  T.E,  Multiple  curved 
descending  approaches  end  the  eir  traffir.  control  prebin.  Moffett  Field, 
Calif  amis:  National  Aeronautical  and  Space  Administration,  Anas  Research 
Center,  NASA  TM-78,  430,  August,  1977. 

The  concepts  investigated  in  this  study  lncludsd;  1)  Multiple  curved  descending 
final  approaches^  2)  parallel  runways  certified  for  independent  end  simultaneous 
operation  vender  IFR  conditions,  3)  clossr  spacing  between  successive  aircraft, 
and  4)  a  distributed  management  system  between  chc  air  and  ground.  Piloted 
simulators  were  supplied  with  computer  generated  traffic  situation  displays  and 
flight  instrument*.  The  controllers  were  supplied  with  a  terminal  area  map  and 
digital  status  information.  Intercrossing  time  variability  was  greater  under 
centralised,  ground-based  management,  than  under  distributed,  pilot-spaced 
management.  Pilots  and  controllers  also  reported  that  the  distributed  manages.  ‘ 
was  more  orderly  then  the  centralized  management.  Flying  provision  Increased 
as  the  amount  of  turn  required  to  intersect  the  outer  marker  decreased.  Pilots 
preferred  the  alternative  of  multiple  curved  descending  approaches  with  wider 
spacing  between  aircraft.  Both  pilots  <md  controllers  felt  that  parallel 
runways  were  acceptable. 


W/L  Car.  Code: 

Op.  Behav.  Code: 

Opinion 

Spare  m.  capacity 
Primary  task 


1 -,  2.2.3,  3.1 
1.,  2.,  3.,  4- 

Rating  scale 
Questionnaire 
Time  estimation 
Single  measures 


Experimental  Flight  simulator  Flight  simulator 

Flight  test 


Hart,  S.  G. ,  McPherson,  D. ,  and  Loomio,  L.  L.  Time  estimation  as  a  secondary 
task  to  measure  workload:  summary  of  research.  Proceedings  of  the  Fourteenth 
Annual  Conference  cn  Manual  Control,  April  25-27,  1978,  University  of  Southern 
California,  Los  Angeles,  693-712.  (NASA  Conference  publication  2060,  Ames 
Research  Center,  Moffett  Field,  California.) 

Actively  produced  intervals  of  time  were  found  to  increase  in  length  and  variability, 
whereas  retrospectively  produced  Intervals  decreased  in  length,  although  they  also 
increased  in  variability  with  the  addition  of  a  variety  of  flight-related  tasks. 

If  pilots  counted  aloud  while  making  a  production,  however,  the  impact  of  con¬ 
current  activity  was  minimized,  at  least  for  the  moderately  demanding  primary 
tasks  that  were  selected.  The  effects  of  faadback  on  estimation  accuracy  and 
consistency  were  greatly  enhanced  if  a  counting  or  tapping  production  technique 
was  used. 


W/L  Cat.  Code: 


2.2.3 


Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Time  estimation  Experimental  Flight  simulator  Flight  simulator 
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Bart,  S.  0.  and  Simpson,  C.  A.'  Effect*  of  linguistic  redundancy  on  synthesized 
cockpit  warning  message  comprehension  and  concurrent  time  estimation. 
Proceedings  of  tbs  11th  AaotmlHA8A-0nl  varsity  Conference  on  Manual  Control, 
University  of  Illinois,  May,  1976,  3&-321. (NASA  TM  X-73  170) . 

The  relative  amounts  of  attention  required  to  comprehend  and  recognise  two 
types  of  speech  massages  that  differed  la  linguistic  redundancy  were  evaluated 
with  two  concurrent  time  estimation  tasks.  Two  word  and  aentence- length 
fiyrthaslBed-speach  cockpit  warning  messages  were  presented  to  12  cosmerclal 
«lrllne  pilots  with  and  without  competing  weather  broadcast.  The  pilots  had 
two  tasks:  a)  to  road  back  and  write  down  the  warning  messages  and  b)  to  give 
two  types  of  time  estimates.  It  was  found  that  the  intelligibility  of  messages 
presented  in  e  redundant  sentence- length  fermat  wee  higher,  and  that  listening 
time  end  number  of  repetitions  wee  lees,  during  the  familiarisation  Phase. 
Sentences  were  also  more  intelligible  then  two-word  message*  when  presented  in 
e  background  of  competing  weather  broadcast  for  rscognitlon.  Differences  in 
verbal  estimate*  of  session  length  end  in  the  length  of  10-sec  estimates 
produced  by  pilots  indicated  that  messages  presented  in  a  sentence  format 
required  leas  attention  fer  comprehension  than  did  two-word  messages. 

W/L  Cat.  Code:  2.2.3 

Op.  Behav.  Code:  1.,  2.,  3.-,  4. 

Spare  m.  capacity  Time  estimation  Experimental  Laboratory  Flight  simulator 

Flight  test 


Hartsmn,  B.  0.,  Hale,  Hi  B.  end  Johnson,  W.  A.  Fatigue  in  FB-111  crewmembers. 
Aerospace  Medicine.  1974,  45,  1026-1029. 

Fifteen  biomedically  dedicated  missions  of  8  h  duration  were  flown  in  the 
FB-111  as  part  of  its  initial  operational  evaluation.  Each  two-sum  crew 
provided  date  on  subjective  fatigue,  discomfort,  efficiency,  and  pre-  and 
poet-mission  sleep.  In  addition,  urine  samples  Obtained  from  one  crew  on  an 
unusually  demanding  mission  were  analysed  for  epinephrine,  norepinephrine,  17- 
hydroxycortlcosterolds ,  sodium,  potassium,  and  urea.  The  date  showed  that  the 
crewa  experienced  moderate  fatigue  and  stress,  aggravatsd  by  physical  discomfort, 
from  which  they  recovered  after  one  night  of  sleep. 

W/L  Cat.  Code:  1.1,  4.1.12 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Rating  seals  Experimantal  Flight  taat  Flight  simulator 

Physiological  Body  fluid  Flight  test 

anal. 
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Hartman,  B.  0.,  and  McKsnsle,  R.  R.  (Eds.;  "urvay  of  wathoda  to  aaaaaa  workload. 
AGARD-AG-246,  August,  1979. 


This  ACARDograph  rapraaanta  an  overview  of  workload  assessment.  It  la  currant 
in  tha  aanaa  that  aach  chapter  la  a  condensation  or  modification  of  recant  papers, 
prepared  by  individual  authors.  The  measurement  domain  has  been  broken  into 
sensory  threshold  function  teats,  motor  function  and  responses  to  psycho,  physio 
and  chemical  excitation.  The  methodology  includes  a  wide  range  of  instrumentation, 
laboratory,  inflight  measurement  and  modeling  methods,  with  the  goal  of  compiling 
(systematically  and  evaluating  the  multiplicity  of  approaches  and  techniques. 

V/t  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Cede:  1.,  2.,  3.,  4. 


Opinion 

Spare  m.  capacity 
Primary  task 
Physiological 


Multiple  Review  Flight  simulator  Flight  simulator 

Construct  Flight  test  Flight  test 

Experimental 


Hartzell,  E.  j.  Helicopter  pilot  performance  and  workload  as  a  function  of  night 
vision  symbologies.  Paper  presented  at  the  Conference  on  Decision  and  Control, 
December,  1979,  Fort  Lauderdale,  Florida. 


The  exp??iment  reported  was  designed  to  assess  pilot  performance,  training 
requirements,  and  workload  as  a  function  of  the  three  symbologies .  Pilot  workload 
is  addressed  in  this  paper.  The  results  of  the  time  estimation  techniques  used 
supported  the  predicted  levels  of  difficulty  designed  into  the  flight  scenario. 
Time  estimation  provided  a  relative  scale  of  workload  between  the  hover  maneuvers 
and  Suggests  that  there  is  no  significant  difference  In  workload  between  the 
three  symbology  types  studied. 


W/L  Cat.  Code: 

2.2.3,  3.1 

Op.  Behav.  Gode: 

1.,  2.,  4. 

Spare  m.  capacity 

Tims  estimation  Experimental 

Flight  simulator  Flight  simulator 

Primary  task 

Single  measures 

Flight  test 
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Bat  Mil,  C.  P.  An  Information  theoretic  humaA  operator  mrdul.  Conference 
Record.  Annual  Asllomar  Conference  on  Circuits.  SwtwB,  and  Computers. 
Pacific  Grove,  California,  November,- 1976.  North  BolJyvood,  California^ 
Wastarn  Periodicals  Co.,  1977,  479-483. 


By  applying  information  thaoratic  concepts  to  control  theory,  a  hraan  operator 
modal  la  developed  which  describes  the  affect  of  stress  on  the  operator  in  tarma  of 
a  partitioning  of  total  information  processed  by  the  operator.  The  nodal  requires 
very  little  a  priori  iapoeed  structure  and  is  consistent  with  the  frequently 
observed  phenomenon  of  catastrophic  failure  of  the  human  operator  at  some  critical 
level  of  stress. 


W/L  Cat.  Code:  2.1; 2,  3.3 


Op.  Pehav.  Code:  1.,  2.,  4. 


Spare  m.  capacity  Inform,  theory  Construct  Laboratory  Flight  simulator 
Primary  task  Math,  modal  Experimental 


Hawkins  L. ,  Church,  M.,  and  deLemos,  S.  Time-sharing  is  not  a  unitary 
abil:  .  Eugene,  Oregon:  University  of  Oregon,  Canter  for  Cognitive  and 

Perceptual  Research,  Technical  Report  No.  2,  June  30,  1976,  (AD  A056  632). 

The  •  .  objective  of  the  three  experiments  reported  here  was  to  further  our 

under »  lings  of  the  nature  of  these  limitations.  The  results  of  the  exjf>wriwent» 

lead  to  'e  conclusion  that  time-ahar 'nc  is  not  a  single  general  ability,  but 
rather  —  dependent  upon  several  mo.*;  .pacific  processing  limltatious.  Tliase 
Include:  (1)  an  inability  early  in  pi;  ;tica  to  simultaneously  select,  or  retrieve, 
multiple  responses  from  memory;  (2)  a  persisting  inability  to  initiate  multiple 
independent  responses  simultaneously;  (3)  inability  to  process,  or  at  least 
efficient1'’  process,  contiguous  inputs  from  separata  modalities  owing  to  the 
need  for  •odality-upecific  attentlonal  focus;  and  (4)  an  inability  to  efficiently 
process  multiple  inputs  from  within  the  ssme  modality  owing  to  the  existence  of 
structure!  interference.  It  is  suggested  that  the  prediction  of  performance  on 
complex  criterion  task  combinations  such  as  entailed  in  piloting  or  air  traffic 
control  requires  specification  of  which  of  these  component  abilities  is  required 
by  the  criterion  situations. 

W/L  Cat.  Code:  2.2.,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  taRk  Experimental  laboratory  Background 

Primary  tack  Single  measures 
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Hsvklna,  B.  L.  Rodrlquex,  E.,  and  Ralcher,  G.  M.  I*  se- sharing  a  general 
capability?  Procttdinia  of  th*  Aanual  MMt?ug  o.:  the  Ham  Factor* 
Society.  Boa  too .  Massachusetts  October  29- November  1.  1979,  532*53$. 


The  tlae-eharing  ability  of  subject*  vu  measured  under  sight  separate  dual-teak 
condltlona.  Three  distinct  teak  characteristics  were  aya tamatically  varied  across 
conditions  in  an  effort  to  manipulate  the  nature  of  the  specific  time-sharing 
demands  deposed.  Bach  condition  contained  two  of  these  characteristics  in  coanton 
with  three  of  tike  remaining  seven  conditions,  one  of  the  characteristics  In  comnon 
with  three  others,  and  none  in  coeaon  with  the  laat  condition.  Time-snaring 
efficiency  correlated  across  conditions  that  impose  similar  processing  demands 
on  the  individual,  but  not  across  conditions  imposing  relatively  dissimilar  demands. 
We  conclude  that  time-sharing  performance  under  present  conditions  is  determined 
by  several  poorly  correlated,  task-specific  subcapacities  rather  than  by  a  single 
general  ability. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Bheav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 


Primary  task 


Single  measures 


Hayashl,  E.  and  Ogawara,  Y.  A  study  of  the  workload  of  sheer  line  inspectors 
based  on  eye-movement  analysis.  Journal  of  Human  Srgology.  1977,  6,  121-126 

The  workload  involved  in  inspecting  surface  defects  of  cut  sheets  in  a  flying 
shear-line  used  in  the  steel  Industry  was  studied.  The  effects  o'  various  factors 
such  as  workplace  conditions  and  operational  and  human  factors  on  the  visual 
inspection  performance  was  Investigated  according  to  the  type  and  nature  of  surface 
defects  to  be  inspected.  The  results  rsvsaled  that  both  pursuing  and  saccadic 
eye  movements  were  essential  in  identifying  defects.  The  pursuing  movements 
apparently  played  a  major  role  in  finding  defects  oa  the  running  ateel  sheets,  while 
saccadic  movements  took  place  at  very  high  rate  near  the  upper  limit  of  eye 
movements  of  3.3  times  per  sesond.  The  line  epeed  was  a  decisive  operational 
factor  for  the  Inspection  performance.  Further,  effects  of  other  factors  including 
defects  per  se,  duration  of  inspection,  end  duration  of  inspection  and  eye-to- 
defects  distance  were  studied.  The  results  were  suggestive  to  reducing  the 
inspection  workload  and  establishing  optimum  conditions  for  future  automation 
and  mechanisation  of  the  line  inspection. 

W/L  Cat.  Code:  4.1.7 

Op.  Behav.  Code:  1.,  2. 

Physiological  Eye  movements  Experimental  Field  Background 


124 


SY2TR-A0 


lulmdi:,  3.  Physiological  reaction*  of  irlvart  as  Indicators  of  road  traffic 
daman In  Driver  performance  studios t  Transport st Ion  RasnsreV  Record  530. 
Washington,  D.C. i  U.g.  Transportation  Research  Board*  Technical  Report 
TFB/TRR-530,  1975,  1-17. 

Sixty  drivers*  all  accustomed  to  a  certain  stake  of  car,  perforated  teat  drives 
along  a  certain  test  road.  A  digital  tape  recorder  was  used  fer  real-tins 
recording  of  the  driver's  physiological  characteristics  (alactrodarmal  response, 
heart  rata,  and  muscle  activity) ,  steering*  and  broking;  the  vehicle  response 
(accelerations  in  three  directions*  velocity,  and  distance  traveled);  and  traffic 
events  as  coded  by  the  ea.pvrliBaat.ar.  The  characteristics  of  the  test  road  vers 
■assured  in  the  field.  Average  response*  vers  calculated  for  the  test  road,  and 
significant  covariations  were  demonstrated  by  using  the  physiological  aeeeures 
as  the  dependent  verieble  end  vehicle  behavior  on  'he  read  es  the  independent 
variable.  It  was  also  found  that  tha  difficulty  of  a  traffic  avent  effect*  both 
tha  driver's  brake  use  end  physiological  responses.  St rase- inducing  road 
characteristics  ere  downhill  grades  end  short  sight  distances.  It  is  suggested 
that  the  driver's  capacity  to  process  information  varies  flexibly  es  task  dsnand 
changes.  Suddan  increases  in  task  demand  can  ba  leveled  out  by  modeling  the  road 
environment,  and  this  makes  the  driver  more  competent  at  dealing  with  hazardous 
situations. 

W/L  Cat.  Codes  3.1,  4.1 
Op.  Behev.  Code:  1.,  2.,  4. 

primary  task  Multiple  Experimental  Field  Flight  oimulator 
physiological  Flight  test 

Helm,  W.R.  Human  factors  test  end  evaluation*  functional  description  inventory 
as  a  test  and  evaluation  tool  development  and  initial  validation  study. 

Voliime  I  and  II.  Patuxent  River,  Maryland:  U.S.  Naval  Air  Teat  ('enter, 
SY-77R-75,  September,  1975. 

A  new  evaluation  method  was  adapted  to  assist  in  field  testing  of  the  human 
factors  aspects  of  aircraft  man-machine  system .  The  method  is  known  as  the 
Functional  Description  Inventory  (FD*  end  requires  a  series  of  investigations 
analyzing  tha  operational  functions  of  tha  crew  members.  The  method  es  nested 
consists  of  a  series  of  investigations  analysing  the  operational  functions  of 
aach  S-3A  crew  member*  with  an  esaential  p*rt  involving  the  determination  of 
roles,  duties,  and  tasks  performed  by  aach  crer  member.  U'ext,  crew  members' 
judgments  were  compiled  on  how  important  these  roles,  duties*  and  tasks  are  for 
mission  success,  how  frequently  they  Are  performed  on  a  typical  mission,  how 
adequate  the  training  has  been  to  insure  effective  performance  of  the  task* 
and  finally  how  effective  the  system  is  in  accomplishing  these  operational 
functions.  Analysis  of  roles,  duties,  and  teaks  across  these  four  dimensions 
provides,  to  c  certain  degree,  an  in-depth  evaluation  of  the  interrelated 
problem  within  the  rmn-machine  system.  The  FDI  as  developed  for  the  S-3A  aircrew 
has  potential  as  a  tool  for  providing  quantifiable  assessment  of  the  human 
factors  aspects  of  aircraft  man-machine  system. 

W/L  Cat.  Code:  1.1 

Op .  Behev .  Code :  1.,  7.,  3.,  4. 

Opinion  Rating  scale  Experimental  Flight  Lust  Flight  simulator 

Flight  feet 


US 


SY-27R-6Q 


Seim,  W.R.  Human  factors  evaluation  of  modal  P-JC  UPDATE  I  airplane:  Third 
interim  report.  Patuxent  lives,  Maryland:  U.S.  Naval  Air  Teat  Center, 
ST-1221-73,  February  1976. 


An  evaluation  of  the  P-3C  UPDATE  I  aircraft  van  conducted  to  determine  the 
workload  Implications  resulting  from  design  modifications.  A  method  known  aa 
the  Functional  Description  Inventory  (FDI)  was  used.  This  method  requires  a 
series  of  investigations  analysing  the  selected  operational  functions  of  specific 
P-3C  crew  members,  with  sn  essential  part  involving  the  determination  of  roles, 
duties,  and  tasks  performed.  Next,  craw  members'  Judgments  were  compiled  on 
how  important  these  roles,  duties,  and  tasks  are  for  mission  success.  It  was 
concluded  that  for  the  S2NS0  1  and  SKNSO  2  the  design  modifications  produced  a 
moderate  increase  in  system  effectiveness  but  operator  workload  requirements 
were  increased  substantially;  for  the  SENSO  3  tha  design  modifications  produced 
substantial  Improvements  in  system  effectiveness  while  substantially  reducing 
operator  workload;  and  for  tha  TACCO  the  design  modifications  produced  improved 
system  operation. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 

Opinion 

Spare  tn.  capacity 
Primary  task 


1.1,  2.1.1,  3.1 
1.,  2.,  3.,  4. 

Rating  scale 
Task  comp., 
time  assess. 
Single  measures 


Construct  None 


Flight  simulator 


Helm.  W.R.  Function  description  Inventory  as  a  human  factors  test  end 

evaluation  tool:  Aa  empirical  validation  study.  Patuxent  River,  Maryland: 

U.S.  Naval  Air  Test  Center,  SY-127R-76,  July,  1976. 

The  Function  Description  Inventory  (FDI)  is  a  new  assessment  methodology.  In 
this  study  the  method  was  modified  to  augment  the  traditional  human  factors 
engineering  field  testing  on  the  S-3A  airplane.  The  FDI  requires  a  series  of 
investigations  analysing  the  operational  functions  of  crewmembers,  with  an 
essential  part  Involving  the  determination  of  roles,  duties,  and  tasks  performed 
by  each  crewmember.  Subsequent  to  this  analysis,  crewmembers'  judgments  were 
compiled  on  how  Important  these  roles,  duties,  and  tasks  were  for  mission  success, 
how  frequently  they  were  performed  on  a  typical  mission,  how  adequate  the 
training  had  been  to  Insure  effective  performance  of  the  task,  and  finally,  how 
effective  the  system  had  been  In  accomplishing  these  operational  functions.  The 
problems  Identified  by  the  FDI  were  then  compared  to  the  actual  engineering 
deficiencies  reported  during  the  BIS  Trials  for  the  S-3A  aircraft.  The  FDI 
identified  the  same  systems  and  related  problems  in  which  numerous  design 
deficiencies  were  reported. 

W/L  Cat.  Code:  1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Flight  test  Flight  simulator 

Flight  test 


SY-27R-40 


helm,  V.  H.  Tha  application  of  computer  aided  evaluative  techniques  co  ay* tea 
teat  and  evaluation.  Proceedings  of  the  21at  Annual  Meeting  of  the  Human 
Factor#  Society.  San  Francisco,  California,  October,  197d,  92-$4. 

Adequate  aaaeaament  of  operator  workload  In  a  complex  system  requires  a 
substantial  testing  program  which  in  turn  yields  large  amounts  of  data.  The 
different  places  of  data  regarding  operator  workload  have  different  relative 
Importance  in  terma  of  Implications  for  required  decisions  such  as  system 
redesign  or  compensatory  training.  Since  no  single  metric  exleto  that  suamarises 
the  data  along  the  relevant  dimension,  a  means  must  ba  employed  to  gather  and 
organise  data  In  a  comprehensive  fashion  that  facilitates  decision  making  about 
auch  factors.  Thia  paper  reports  on  the  feasibility  of  the  application  of 
computer  aided  avaluativa  techniques  in  combining  precise  pieces  of  test 
information  Into  summary  measures  at  differing  levels  of  generality  to 
facilitate  decisions  about  operator  workload  and  system  acceptability. 

V/L  Cat.  Coda:  1.1,  2.1.1,  3.2 

Op.  Behav.  Coda:  1.,  2.,  3.,  4. 

Opinion  M>.lt.  measures  Construct  None  Flight  simulator 

Spare  m.  capacity 
Primary  task 


Henry,  P.H,,  Daviu,  T.Q.,  Engelken,  E.J.,  Trlebwasser,  J.H,  and  Lancaster, 

M.C.  Alcohol-induced  performance  decrements  assessed  by  two  link  trainer 
tasks  using  experienced  pilots.  Aerospace  Medicine,  1974,  45,  1180-1189. 

The  degrading  effects  of  ethanol  on  performance  of  two  separate  tasks  developed 
around  tho  Link  GAT-1  trainer  were  studied  in  12  USAF  instructor  pilots.  The 
subjects  were  tested  at  three  alcohol  dose- levels.  Statistically  significant 
performance  decrements  were  found  for  only  the  moderate  and  high  alcohol  doses. 
The  magnitudes  of  the  decrements  corresponded  closely  to  those  reported  for 
previous  experiments  using  the  same  test  conditions  but  with  subjects  who  had 
no  previous  flying  experience.  An  assessment  of  the  operational  significance 
of  the  performance  measuring  scales  was  also  attempted  through  the  uae  ot  special 
questionnaires  and  by  concurrent  rating  of  performance  by  flight  examiners. 

Limits  were  established  for  decrement  scores  indicative  of  an  operationally 
significant  haxard. 

H/L  Cat.  Codes:  1.1,  3.1 

Op.  Behev.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Primary  task  Single  measures  Flight  test 


SY-27R-M 


Herman,  L.  N.  £cudy  of  the  single  channel  hypothesis  and  Input  regulation  within 
a  continuous,  simultaneous  task  situation.  Quarterly  Journal  of  Rxpsrlmautal 
Psychology.  1565,  17,  37-46. 

Subjects  performed  simultaneously  on  an  auditory  tracking  and  an  auditory 
discrimination  task,  with  each  task  presented  to  a  serrate  ear.  Information 
transmitted  in  the  tasks  was  measured  as  a  function  of  ability  to  predict  task 
characteristics,  input  Information-rate,  and  input  discrimi  liability.  Bused  on 
comparison  of  single-  versus  simultaneous-task  performance,  support  was  found  for 
a  single,  central  decision-type  channel  in  Information  processing,  having  as  one 
primary  limit  the  rate  at  which  Information  can  be  accepted.  Diacrlmin ability 
of  inputs  also  was  found  to  be  a  limit  on  information  processing  rate.  Although 
ability  to  predict  a  task's  chsracterls tics  facilitated  performance  on  that  task, 
in  this  experiment  it  did  not  result  in  facilitatior,  of  performance  in  the 
second  task. 

W/L  Cat.  Code: 

Op.  Behav.  Code: 

Spare  m.  capacity 

Primary  task 


2.2.1,  2.2.2,  3.1 
1.,  2.,  3.,  4. 

Subsidiary  task  Experimental  Laboratory  Background 
Single  measures 


Hess,  h.  A.  and  Teichgraber,  W.  n  Error  quantisation  effects  in  compensatory 
tracking  tasks.  IEBE  Transact Iona  on  Systems,  Man,  and  Cybernetics,  1974, 
SMC-4.  343-349. 

Experiments  were  performed  to  determine  the  effect,  of  error  signal 
quantisation  on  human  operator  compensatory  tracking  performance.  Single-axis, 
dual-axis,  and  cross-coupled  critical  tracking  tasks  were  utilised  with  a 
variety  of  quantisation  formats.  The  controlled  element  dynamics  were  chosen 
to  force  the  operator  to  incorporate  varying  amounts  of  l*:ad  equalisation. 

The  single-  and  dual-axis  critical  tasks  served  as  sensitive  Indicators  of 
display  format  effects,  with  single-axis  task  yielding  information  concerning 
the  operator's  effective  time  delay  while  tracking.  The  cross-coupled  task 
allowed  measurement  of  the  operator's  Attentlonal  workload  margin  while  using 
error  quantised  displays.  The  results  indicate  increased  operator  time  delays 
and  attentlonal  workload  when  using  the  quantised  displays. 

W/L  Cat.  Code:  2.2.5,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measure?  Flight  test 


128 


SY-27R-B0 


Kickok,  J.  H.  Grip  pressure  as  a  measure  of  task  difficulty  In  compensatory 
tracking  tasks.  Master's  thesis.  Naval  Postgraduate  School,  Monterey, 
California,  September,  1973.  (AO  769  744). 

The  feasibility  of  utilising  the  grip  pressure  exerted  on  a  rigid  control  stick 
aa  a  Measure  of  tracking  task  difficulty  was  investigated.  A  device  was 
engineered  to  measure  grip  pressure  independent  of  control  force.  A  hybrid 
computer  was  used  to  produce  the  tracking  tasks  necessary  in  the  research  and 
on-line  data  computation.  Compensatory  tracking  tasks  using  K/s,  K/a(s+2)  and 
K/s^  controlled  elements  provided  the  difficulty  levels,  from  easiest  to  most 
difficult.  Results  indicate  that  grip  pressure  increases  significantly  with 
task  difficulty  aa  the  operator  attempts  to  reduce  hlo  effective  tlM  delay. 
However,  grip  pressure  also  appears  to  be  dependent  upon  the  "gain"  which  a 
human  adopts  in  a  particular  tracking  task.  This  gain-related  grip  pressure 
My  not  be  related  to  task  difficulty. 

W/L  Cat.  Coda:  3.1,  4.1.9 

Op.  Behav.  Code:  1. ,  2. ,  4. 

Primary  task  Slagle  measures  Experimental  Laboratory  Plight  simulator 
Physiological  Muscle  tension  Flight  test 


Hicks,  J.  A.,  Ill  and  Soliday,  S.  M.  An  eviluatlon  of  sinus  arrhythmia  aa  a 
measure  of  mental  ioa^.  lu  W.  B.  Knowles,  M.  Sanders,  and  F.  Muckier  (Eds.) 
Proceedings  of  the  Sixteenth  Annual  Hearing  of  the  Human  Factors  Soceity , 

1972,  191-196. 

The  primary  purpose  of  this  Investigation  was  to  provide  an  evaluation  and 
validation  of  sinus  arrhythmia  aa  a  measure  of  mental  workload.  Sinus  arrhythmia 
refers  to  the  irregularity  in  the  length  of  the  inter-beat  intervals  found  in  the 
heart  rate  pattern  of  a  normal  individual  sitting  at  rest.  Previous  research  had 
Indicated  that  this  irregularity  disappears  aa  a  function  of  the  Mntal  load 
imposed  on  the  individual.  A  secondary  purpose  of  this  investigation  was  to 
compare  the  sinus  arrhythmia  approach  to  estimating  mental  workload  with  a 
secondary  task  loading  technique. 

W/L  Cat.  Cede:  2.2.2,  4.1.10 

Physiological:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulation 

Physiological  Heart  rate, 

h.r.  var. 


1 2.9 


SY-Z7R-80 


Hicks,  ?.G.  and  Wlerwllle,  W.W.  Ccmperisem  of  five  mental  workload  assessment 
procedures  in  a  moving-base  driving  simulator.  Human  Factors ,  1979,  21, 
129-143. 

Five  methods  of  measuring  mental  workload  (secondary  task  performance,  visual 
occlusion,  cardiac  arrhythmia,  subjective  opinion  rating  scales,  and  primary 
task  performance)  were  compared  for  sensitivity  to  changes  in  operator  loading. 
The  driving  task  was  produced  using  an  automobile  drivi:  g  simulator  with  a  sxx- 
degree  of  freedom  computer  generated  display,  a  four-degree  of  freedom  physical 
motion  system,  and  a  four-channel  sound  system.  Subjects  were  presented  with  a 
withln-subjects  factor  of  wind  gust  placement.  The  results  shoved  significant 
differences  among  workload  levels  for  subjective  opinion  scales  and  primary 
performance  measures  of  lateral  deviation,  yaw  deviation,  and  steering  reversals. 
A  relative  sensitivity  estimate  of  these  would  be,  from  highest  to  lowest 
sensitivity,  steering  reversals  and  yav  deviation,  rating  sca3.es,  and  lateral 
deviation.  The  techniques  of  occlusion,  cardiac  arrhythmia,  and  secondary  task 
performance  yielded  no  significant  workload  effect. 

W/L  Cat.  Code:  1.1,  2.2.1,  2.3,  3.2,  4.1.10 

Op .  Behav .  Code :  1 . ,  2 . ,  4 . 

Opinion  Rating  scale  Experimental 

Spare  m.  capacity  Subsidiary  task 
Primary  task  Occlusion 

Physiological  Mult,  measures 

Heart  rate 
h.r.  var. 


Simulator  Flight  simulator 
Flight  test 


Hllgendorf,  E.  L.  Information  processing,  practice,  and  spare  capacity. 
Australian  Journal  of  Psychology.  1967,  19.,  241-251. 


The  relationship  between  information  input  and  response  time  wat-  studied  during 
extended  practice,  using  visual  stimuli  of  up  to  ten  bits  of  Information  per 
stimulus.  Response  time  was  found  to  be  directly  related  to  information  input 
and  the  relationship  was  found  to  persist  after  practice,  contrary  to  findings 
reported  in  several  recent  studies.  On  the  final  trial  a  secondary  auditory 
task  was  introduced.  Performance  on  this  task  was  inversely  related  to  the 
information  content  of  the  primary  task,  which  showed  a  significant  decrement 
when  both  casks  were  performed  concurrently.  Five  hypotheses  derived  from 
ear der  work  are  examined  in  the  light  of  the  results  obtained. 


W/L  Cat.  Code:  2.2.1,  3.1 


Op .  B  hev .  Code ;  1 . ,  2 . ,  3 . ,  4 . 


Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 


Primary  task  Single  measures 


Flight  test 


130 


SY-27R-80 


Hinton,  S-.  A.  «nd  Shaughnessy,  J.  D.  Adaptation  of  tisoe-line  analysis  progran 
to  single  pilot  instrument  flight  research.  Heap ton,  Virginia:  National 
Aeronautics  and  Space  Administration  (Langley  Research  Center),  NASA-TM- 
78748,  August,  1978. 

A  data  base  was  developed  for  SPIRF  operation  and  the  program  was  run.  The 
outputs  indicated  that  further  work  was  necessary  on  the  workload  models.  In 
particular,  the  workload  model  for  the  cognitive  channel  should  be  modified  as 
the  output  workload  appears  to  be  too  small.  Included  In  the  needed  refinements 
are  models  to  show  the  workload  when  In  turbulence,  when  overshooting  a  radial 
or  glldeslope,  and  when  copying  air  traffic  control  clearances. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2..  3.,  4. 

Spare  m.  capacity  Task  comp..  Experimental  Laboratory  Flight  simulator 

time  assess. 


Hoffman,  E.  R.  and  Joubert,  P.N.  The  effect  oi‘  changes  in  some  vehicle 

handling  variables  on  driver  steering  performance.  Human  Factors,  1966,  8, 
245- 76? . 


The  literature  on  vehicle  handling  is  summarised.  Experiments  were  carried  out 
to  determine  the  effect  of  vehicle  response  time,  steering  gear  ratio,  and  near- 
and  far-sight  distances  on  driver  performance  on  a  tracking  task  consisting  of 
driving  through  a  narrow  winding  course  marked  by  traffic  cones.  The  vehicle 
response  time  was  found  to  affect  greatly  the  number  of  cones  touched  by  the 
vehicle  during  a  set  testing  time.  Increasing  near-sight  distance  produced  poorer 
driver  performance.  This  also  occurred  for  the  case  of  decreasing  far-sight 
distances  with  fixed  near-sight  distance.  Tests  with  variations  of  steering  ratio 
and  steering  torque  produced  little  change  in  driver  performance.  , Spare  mental 
capacity  was  measured  during  the  test  period.  For  this  indirect  measurement  of 
task  difficulty,  changes  in  the  spare  mental  capacity  of  the  driver  wer^  found 
to  have  the  same  sensitivity  to  changes  in  the  vehicle,  as  did  the  change  in  the 
number  of  cones  touched  by  the  vehicle. 


W/L  Cat  Code:  2.2.1,  3.1 

Op »  Behav .  Code :  1*,  2.,  4. 


Spare  m.  capacity  Subsidiary  task  Experimental  Field 

Primary  task  Single  measures 


Flight  simulator 
Flight  test 


131 


SY-27R-S0 


Holden  F.M. ,  Rogers,  D.B.  and  Replogle,  C.R.  Simulation  of  high  workload 
operations  in  air  to  air  combat.  Proceedings  of  the  AG ARP  Conference  on 
Simulation  and  Study  of  High  Workload  Operations.  AGARD-CP-146 ,  April,  1974, 
A6— 1  -  A6-4. 


General  methods  and  techniques  for  predicting  the  mist-ion  effectiveness  of 
candidate  systems  in  the  preliminary  design  stage  and  predicting  the  human 
operator's  subjective  preference  for  the  candidate  designs  are  not  generally 
available.  For  those  techniques  which  have  been  used,  with  some  success,  there 
exists  the  question  of  validation  and  general  applicability.  This  report 
discusses  the  problems  associated  with  workload  measurement,  provides  a 
structure  for  the  study  and  analysis  of  human  performance  and  describes  the  tools 
and  techniques  used  by  the  6570th  AMRL/EM  to  provide  effectiveness  versus  design 
data. 

W/L  Cat.  Code:  3.3 

Op.  Behav.  Code:  2.2,  4.2 

Primary  task  Math,  model  Experimental  Flight  simulator  Flight  simulator 


Holland,  M.  K.  and  Tarlow,  G.  Blinking  and  mental  load.  Psychological 
Reports.  1S72,  31,  119-127. 

The  rate  of  blinking  is  related  to  certain  mental  activities.  One  common 
feature  of  states  associated  with  low  blink  rates  is  the  presence  of  con¬ 
centrated  cognitive  activity.  The  purpose  of  the  present  study  was  to 
determine  how  blinking  is  affected  by  variation:*  in  mental  load;  it  was 
hypothesized  that,  for  a  given  nonvisual  task,  blinking  would  decrease  as 
mental  load  increased.  The  first  study  reported  here  manipulated  memory 
load  by  requiring  Ss  to  retain  a  sequence  of  4,  6,  or  8  digits.  The  second 
study  involved  mental  arithmetic  under  time  pressure;  half  the  trials 
contained  zeros  in  the  sequence  of  numbers  to  bs  summed.  In  both  studies 
the  rate  of  blinking  was  low  when  mental  load  was  high  and  the  rate  was  high 
when  mental  load  was  low.  It  is  speculated  that  blinking  may  disrupt 
certain  cognitive  proce»ses  and  may  therefore  be  inhibited  when  these 
processes  are  active.  When  mental  load  is  increased,  the  inhibition  of 
blinking  may  be  an  adaptive  mechanism  which  protects  vulnerable  cognitive 
processes  from  Interference. 

W/L  Cat.  Code:  3.1,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 
Physiological  Eye  movement 
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Uophin ,  V.  0.  Mental  workload  measurement  in  air  traffic  control.  lit  N.  Moray 
(Ed.)  Mental  workload:  Its  theory  and  measurement . '  Kaw  York:  Plenum  Press, 
1979,  381-385. 

Moat  possible  measures  of  mental  workload  have  been  proposed  and  tried  in 
air  traffic  control  but  have  not  proved  to  be  helpful.  This  note  outlines 
some  of  the  current  practical  problems  in  assessing  mental  workload  in  air 
traffic  control,  while  emphasizing  the  vital  need  to  have  impartial 
quantitative  measures  fer  doing  so,  both  to  ensure  the  safety  and  efficiency 
cf  future  systems  and  to  design  jobs  which  have  an  optimum  blend  of  workload. 


utilization  of  skill, 

W/L  Cat.  Code:  1. , 

Op.  Behav.  Code:  1., 

and  job  satisfaction. 

2.,  3.,  4. 

2. ,  3. 

Opinion 

Spare  m.  capacity 

Primary  task 

Physiological 

Multiple  Construct 

None 

Flight  simulator 

Flight  test 

Hopkin,  V.  D.  and  Napier,  A,  W.  Time  estimation  in  a  flight  simulator, 

Famborough.  Hants,  England:  RAF  Institute  of  Aviation  Medicine, 

IAM-R-232,  1963. 

Subjects  made  their  own  unaided  estimate  of  time  while  performing  simulSwed 
manoeuvres.  The  entire  flight  plan  had  a  demanded  time  of  40  minutes.  Each 
subject  performed  the  whole  flight  task  twice.  In  one  case  he  vas  instructed  to 
take  all  the  deuandeu  time  to  complete  each  manoeuvre  end  to  set  his  rate  of  change 
accordingly.  In  the  other  case  he  waa  told  to  complete  the  manoeuvres  as  quickly 
as  possible  and  then  to  maintain  that  position  until  he  thought  the  demanded  time 
had  elapsed  since  the  beginning  of  the  manoeuvres.  Deviations  from  the  demanded 
height,  heading  and  time  were  used  as  performance  criteria.  It  was  found  that  'date 
estimates  were  related  to  the  complexity  of  the  demanded  flight  manoeuvres ,  to 
the  subject's  previous  experience  with  a  flight  simulator  and  to  the  instructions 
given,  but  errors  in  the  time  estimation  did  not  relate  systematically  to  the 
length  of  the  demanded  time. 

W/L  Cat,  Code:  2.2,3,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Time  estimation  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  measures  Flight  test 
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Hosman ,  R.  J.  A.  W.  Pilot' •  tracking  behavior  under  additional  worklcut . 
Delft,  The  Netherlands:  Delft  University  of  Technology,  Department  of 
Aeronautical  Engineerir;**,,  Report  UTB-199 ,  June,  1975. 

An  experiment  to  study  the  influence  of  task  interference  on  the  information 
processing  of  the  human  pilot  if  described.  Two  hypothetical  limited 
capacity  models  of  human  Information  processing,  the  multi-channel  model 
and  the  single-channel  model,  are  reviewed  and  the  results  of  the  experiment 
are  discussed  in  relation  to  these  models.  The  experimental  task  consisted 
of  a  single  axis  tracking  task  under  additional  workload.  The  three 
controlled  elements  used  were  a  simulated  transport  aircraft  at  three 
different  center  of  gravity  positions,  at  which  it  waB  stable,  neutral,  and 
unstable,  respectively.  The  forcing  function  was  a  gust  signal  acting  on  the 
simulated  aircraft.  The  additional  loading  task  was  an  auditory  binary 
choice  task.  The  results  of  the  experiment  tend  to  favor  the  single-channel 
model  of  human  information  processing. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  taak  Experimental  Laboratory  Flight  simulator 


Howells,  R.  A.,  Knight,  J.  L. ,  Jr.,  Wetss,  S.  M.  Micro- timesharing  within  a 
8 ingle  task.  Proceedings  of  the  23rd  Annual  Meeting  of  the  Human  Factors 
Society,  Boston,  Massachusetts,  October  29-November  1,  1979,  523-526. 

In  continuous,  reciprocal  Fitt3'  Law  tapping,  movement  timing  and  spatial  accuracy 
control  may  be  considered  as  two  micro-tasks  within  an  overall  psychomotor  task. 
Usually,  timing  demands  are  secondary  while  the  spatial  accuracy  is  stressed. 

In  an  experiment  in  which  both  timing  and  spatial  demands  were  manipulated  and 
equally  important,  subjects  ware  required  to  divide  available  attention  between 
these  performance  dimensions.  Results  are  discussed  in  terms  of  current  time¬ 
sharing  models . 

W/L  Cat.  Code:  2.1.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Inform,  theory  Experiment  Laboratory  Background 
Primary  task  Single  measures 


% 
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Howitt,  J.  S.  Flight-deck  workload  studlee  is  t-ivil ^transport  aircraft.  , 
Proceedings  of  the  AGARS  Conference  on  Measure  of  Aircrew  Performance. 
AGARD- CP-56,  December,  1969,  1-3  -  1-7. 

The  tern  'Work  Load  Study'  can  be  Interpreted  in  many  ways  depending  on 
one's  particular  Interest  .-*d  point  of  view.  During  the  past  four  years 
a  snail  teas  has  been  conducting  field  studies  in  civil  airlines  during 
both  long-haul  and  short-haul  operations.  The  teas  have  found  such  studies 
can  be  conveniently  divided  into  three  main  areas:  (1)  that  associated 
with  short  tern,  or  instantaneous  workload;  (2)  that  associated  with 
accunulated  effects  of  workloads  over  a  particular  period;  and  (3)  that 
associated  with  the  total  working  envlronnent.  Some  of  the  methods  used 
and  the  indications  for  further  areas  of  research  are  discussed. 

W/L  Cat.  Code:  1.1,  2.1.1 

Op.  Behav.  Code:  2. 


Opinion 

Spare  n.  capacity 


Rating;  scale 

Task  coup 
time  assess. 


Review  Field 


Flight  simulator 
Flight  tee*. 


Howitt,  J.  S.,  Hay,  A.  E. ,  Shergold,  G.  R. ,  and  Ferres,  H.  M.  Workload  and 


fatigue- in-flight  EEG  changes. 
1978,  49,  1197-1202. 


Aviation.  Space  and  Environmental  Medicine, 


Continuous  recordings  were  made  of  the  EEG  and  ECG  of  one  pilot,  during  a  series 
of  Instrument  flights  In  a  feeder-type  transport  aircraft.  The  flights  were 
arranged  to  contain  epochs  of  distinctly  differing  levels  of  workload.  Soma  flights 
were  made  after  a  night  of  sleep  deprivation  and  others  were  made  as  the  second 
and  third  flights  of  the  day.  Subjectively,  there  appeared  to  be  marked  differences 
in  performance  between  the  two  types  of  tired  flight.  The  EEG  analyses  showed 
changes  that  correlated  well  with  differences  in  workload.  In  the  highest  workload 
areas  during  fresh  flights,  EEG  activity  increased  by  approximately  a  factor  of 
4  over  that  of  the  preflight  resting  values.  This  large  increase  did  not  occur 
in  the  tired  flights. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Opinion 
Physiological 


1.2,  4.1.3,  4.1.5 
1. ,  2. ,  4. 

Questionnaire  Experimental  Flight  test  Flight  simulation 
EEG  Flight  test 

EKG 
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Huddlerton,  J.  H.  F.  Personality  and  apparent  operator  capacity.  Perceptual 
and  Motor  Skills .  1974,  38,  1189-1190. 

Twenty- four  adults  vara  required  to  perform  a  pursuit  tracking  task  and 
givnn  the  opportunity  to  accept  a  concurrent  second  one  as  soon  aa  they 
felt  theeaalves  capable  of  doing  so.  Personality  tests  showed  that  the 
more  anxious  Individuals  delayed  acceptance  of  thin  secondary  task.  No 
rala:ionshlps  ware  found  between  personality  and  tracking  skill  as  such. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures 


Huddleston,  H.  F.  and  Wilson,  R.  V.  An  evaluation  of  the  usefulness  of 
four  secondary  tasks  in  assessing  the  effect  of  a  lag  in  simulated 
aircraft  dynamics.  Ergonomics .  1971,  14,  371-380. 

Eight  male  subjects  were  required  to  perform  a  tracking  task  using  an 
electronic  windshield  display.  The  task  had  two  levels  of  difficulty,  an 
essentially  unlagged  condition  and  a  condition,  chosen  to  be  perceptibility 
more  difficult,  having  an  exponential  lag  of  0.5  sec.  integrated  tracking 
error  scores  alone  were  unable  to  distinguish  between  the  two  difficulty 
levels.  Four  secondary  tasks  were  utilized  involving  a  response  to  digits 
presented  in  the  forward  field  of  view.  The  four  tasks  were  arranged  to  be 
of  comparable  difficulty  level  in  pretests  using  the  same  subjects.  Two 
secondary  tasks  indicated  a  difference  between  the  primary  task  conditions. 

The  addition  of  a  secondary  task  also  permitted  tracking  error  scores 
themselves  to  Indicate  a  difference. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 
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Hughs*,  H.  K. ,  Harttaan,  B.  0.,  Garcia,  R.  and  Lozano ,  P.  Systems  simulation:  A 
global  approach  to  aircrew  workload.  Proceeding*  of  tha  AGARD  Confaranca  on 
Simulation  and  Study  of  High  Workload  Operations,  AGARD-CP-146,  April,  1974, 
Al-1  -  Al-14. 

Aircrew  workload  can  bs  studlad  at  aany  different  levels  of  detail.  In  Che 
most  general  sense,  It  la  a  function  of  tha  total  workload  lnpoaed  upon  a  unit 
in  relation  to  the  nuaber  of  craws  In  that  unit.  An  airlift  system  simulation 
program  has  bean  designed  using  this  global  approach  and  a  nuaber  of  simulation 
studies  have  been  performed.  Outcomes  in  terms  of  systems  effectiveness 
maasurss,  crew  workload,  and  crew  welfare  measures  are  presented. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code.  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp..  Construct  Flight  simulator  Flight  simulator 

time  assess. 

Experimental  Flight  test 


Hurst,  M.  W.  and  Rose,  R.  M.  Objective  workload  and  behavioral  response  in 
airport  radar  control  rooms.  Ergonomics .  1978,  21  559-585. 

Previous  research  Indicated  that  peak  traffic  and  the  duration  of  radio-communications 
’ire re  good  predictors  of  behavioural  response  of  air  traffic  controllers  working 
In  air  route  traffic  control  centres.  In  this  study  we  investigated  if  these  two 
measures  -i  r  rkload  were  generallzable  to  controllers  (ATCs)  working  in  radar 
faciliti<'«‘  ■»erving  major  airports.  3,110  observations  were  made  on  radar  sectors 
at  the  ' re  control  rooms  in  the  U.S.A.  A  large  nuaber  of  air  traffic 
variav'  void  cot-Juuication  tasks  were  measured.  Behavioural  ratings  were  made 
by  expe.  _  >bserver  ATC's.  The  results  replicated  previous  findings  that  peak 
traffic  aud  the  duration  of  radio- communications  functioned  as  behavioural  stressors. 
Careful  consideration  of  these  and  other  results  lad  to  the  conclusion  that  peak 
traffic  is  the  most  generallzable  environmental  rtressor  for  ATC's  behaviour 
whereas  the  other  workload  measures  are  more  correctly  viewed  as  concomitants. 

W/L  Cat.  Code:  1.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  .  .ilnr  .a  Experimental  Field  Flight  simulator 

Primary  task  Single  measures 


SY-27R-80 


Hurt*’,  M.  W.  ctd  Rose,  R.  H.  Objective  job  difficulty,  behavioral  response ,  and 
•actor  characteristics  in  air  route  traffic  control  centres.  Brgoncjplca, 

1978,  21,  897-708. 

Observations  on  47  radar  sector*  in  Ronton  and  Savr  York  war*  used  to  determine 
the  principal  behavioral  atroaaor*  it>  the  .iir  traffic  control  environment. 

Predictor  variable*  included  peak  traffic,  naan  airspeed,  sector  area.  Sector  type, 
radlo-co— unlcetion  time,  and  theoretically  derived  control  load  factors.  Expert 
observers  rated  the  degree  of  activity  and  behavioral  arousal  of  ATCa  working  the 
87  radar  sector*  at  the  sane  tine  the  objective  measure*  were  made.  These  'pace* 
ratings  vers  significantly  related  to  pack  traffic  count  and  duration  of  radio- 
cooeiunicationa.  The  control  load  factors  were  not  related  to  behaviors!  responses. 
Statistical  analyses  indicated  several  refinements  for  the  definition  and 
measurement  of  the  control  load  factors.  For  example,  airspace  control  load  was 
reliably  estimated  by  sector  type  and  number  of  transitioning  planes,  while 
co-ordinaticm  control  load  was  most  appropriately  estimated  by  during  of  radio¬ 
communications.  The  results  suggest  that  estimation  of  workload  may  be  made  by  a 
relatively  few  objective  measures. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Opinion 
Primary  task 


1.1,  3.1 
1«,  1*,  3.,  4.1 
Rating  scale  Experimental 
Single  measures 


Field 


Flight  simulator 


Hutcherson,  R.  C.  Statistical  analysis  of  steroid  levels  in  parotid  secretions 
of  htasans  under  prolonged  mental  stress.  Master's  thesis.  Texes  A  &  M 
University,  College  Station,  Taxes,  December,  1971-  (AD  747  682). 

Ten  subjects  of  approximately  the  same  age,  sice  and  education  group,  were 
exposed  to  an  unchanging  mental  stress  for  a  two  hour  period.  Using  sour  candies 
to  stimulate  parotid  gland  activity,  pacotid  £lu*d  samples  were  collected  at 
thirty  minute  Intervals.  Statistical  analysis  of  the  steroid  levels  showed  that 
there  was  no  significant  change  in  cortisol  levels  in  parotid  fluid  evar  the 
two  hour  sampling  period. 


W/L  Cat.  Code: 
Op.  Behav.  Code : 
Physiological 


4.1.12 

1.,  2. 

Body  fluid 
anal. 


Experimental  Laboratory  Background 


138 
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Hyndman,  V.  W.  and  Cregory,  J.  R.  Spectral  analysis  of  alnua  arrythala  during 
mental  loading,  Ergonomics.  1975»  18,  255-270. 

A  technique  ia  prasantad  for  digitally  processing  cardiac  intervals  to  produce  the 
low-past  filtered  cardiac  event  sequence  (LPFCKS) ,  a  regularly  sampled  (in  tine) 
hand-llnitsd  signal,  representing  in  a  standard  font  the  information  contained 
in  the  cardiac  intervals.  The  technique  takes  into  account  the  physiological 
nechanians  of  information  transfer  across  the  pacemaker,  and  thereby  produces  s 
signal  that  has  a  phyelologlcal  counterpart:  autonomic  activity  converging  on  the 
slno-atrlal  node.  The  scoring  technique  is  shown  to  give  a  reliable  Indication 
of  mental  loading  (and  por *ibly  reserve  capedty)  in  decision-making  teeke. 
Possible  mechanisms  of  reduced  sinus  arrythmla  with  mental  loading  are  explored. 

W/L  Cat.  Code:  4.1.10 

Op,  Behav.  Code:  1.,  2. 

Physiological  Heart  rate.  Experimental  Laboiotory  Flight  simulator 

h.r.  var. 


Inbar,  G.  F.  and  Eden,  G.  Psychological  stress  evaluators:  EKG  correlation 
with  voice  tremor.  Biological  Cybernetics,  1975,  24,  165-167. 

Temporal  measurements  of  frequency  change?  in  the  human  voice  and  trt&aur  in  the 
muscles  of  the  vocal  ares  suggest  that  these  phenomena  are  correlated.  A  measure 
of  muscular  activity  was  obtained  using  a  non  linear  filter  on  the  EMG  wave. 
Frequency  changes  were  detected  in  the  third  formant  of  the  voice  spectrum.  The 
crosscorrelation  results  indicate  that  the  voice  vibrations  ar»>  forced  oscillations 
generated  by  central  nervous  activity,  explaining  the  detection  of  stress  from 
voice  records. 

U/L  Cat.  Code:  4.3 


1. ,  2.,  3. 

Speech  patt. 
anal. 


Op.  Behav.  Code: 
Physiological 


Experimental 


Laboratory 


Background 
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Inoaatc,  0.  to i  evaluation  of  heart  rate  variability  In  different  levels  of 
mantel  loading*  Journal  o*  fTfflT  *ir«oloxf.  (Studle  Psychologic*) ,  1977, 

6,  208-210. 

Six  adult  nale  subjects  took  part  in  visual  search  work  demanding  four  levels  of 
short-tatti  memory*  The  task  wee  to  delete  one,  tvo,  three,  or  four  kinds  cf 
numerals  Included  in  a  table  of  30f  two-digit  nuaerals  which  were  randomly  arranged 
in  10  rove.  Of  300  n me rale,  60  were  to  be  deleted,  those  sixty  nuaeralo  consisted 
of  e  single  two-digit  nunber  in  task  Wl,  two  n uabers  in  task  W2,  three  numbers 
in  teak  W3,  and  four  nusibere  in  task  W4.  Of  tna  four  indices,  only  the  Irregularity 
score  decreased  significantly  as  the  tesk  difficulty  increased.  This  would  mean 
that  particular  rhythm  in  hoart  rate  fluctuation  could  be  note  sensitive  to  aental 
strain  than  other  aspects  of  heart  rate  changes.  Thus .  for  application  of  the 
evaluation  method,  exclusion  of  heart  rate  fluctuations  triggered  by  physical 
movemantr  or  other  external  factors  seems  necessary.  In  addition,  the  large  in^er- 
indiyiduel  differences  in  changes  of  hsart  rate  variability  should  be  properly 
taken  into  consideration. 


W/L  Cat.  Coda: 

4.1.10 

Op.  Behav.  Code: 

1. ,  2. ,  4. 

Phsyiological 

Heart  rate.  Experimental 

h.r.  var. 

Laboratory 

Flight  simulator 

Ioseliani,  K.  K. 

Timn  deficit  as  a  stress  factor 

during  an  operator's  mental 

activity  lu  the  aaa.-f light  vehicle  system.  Kosmlcheskala  Blologiia  1  Meditaina. 
1971,  5,  40-43.  (In  Russian.) 

The  efficiency  in  handling  cotibina Jions  of  control  signale  on  a  panel  was 
evaluated  in  experiments  with  a  group  of  250  healthy  subjects  performing  various 
task  sequences  under  stress  due  to  time  pressure.  According  to  the  quality  of 
their  operational  behavior  the  subjects  were  graded  in  a  high  performance  group 
of  135,  a  medium  performance  group  of  95,  and  n  low  performance  group  of  20, 
with  8  subjects  being  too  hastv  and  12  subjects  being  too  slow  in  the  last  group. 


W/L  Cat.  Code:  2.1.1,  3.1 


Op.  Behav.  Code:  1.,  2.,  4. 


Spare  m.  capacity 
Primary  task 


Task  comp. ,  Experimental 

times  assess. 

Single  measures 


Laboratory 


Flight  Simula ter 
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larnli  3,  B,,  Gb«tMyi  G.  L«,  Vieknii  C.  D. ,  and  Donchln,  I.  P300  and  tracking 
difficulty  t  svlnaace  for  atultipla  raaourcaa  in  dual- task  performance. 
Vsychojophyaiologi  (in  peas*). 


S«*jar,ta  performed  a  viaual  tracking  task  whiln  performing  a  concurrent  task 
in  which  tones  vara  covertly  counted.  The  P300  component  of  the  event-related 
potentials  elicited  by  the  tones  was  examined  to  determine  the  extent  to  which 
its  amplitude  was  affected  by  variations  in  the  forcing- function  bandwidth,  or 
difficulty,  of  the  tracking  task.  P300  decreased  in  magnitude  whan  ^ones  warn 
counted  in  conjunction  with  ths  performance  of  the  tracking  teak,  relative  to  e 
a ingle-- task  counting  condition.  Increasing  tracking  difficulty  foiled  to  reduce 
P300  amplitude  further.  A  second  experiment  obviated  the  poeelbllity  that 
movoment-relstad  potentials  caused  the  P300  attenuation  resulting  from  the 
introduction  of  the  tracking  task,  tn  the  third  experiment,  subjects  performed 
e  reaction  time  teak  in  conjunction  with  tracking  to  aatabliah  the  validity  of  the 
tracking  difficulty  manipulation.  The  results  are  interpreted  in  terms  of  a 
theory  or  functiooally-speclfic  processing  resources. 


H/L  Cat.  Code:  2.2.1.  4.1.6 

Op.  Bahav.  Code:  1..  2.,  3.,  4. 


Spare  a.  capacity  Subsidiary  task  Experimental  Laboratory  Background 


Physiological  EC? 


Isreal.  J.  B.,  Wlckens,  C.  0.,  Chcsnev  g.  L.»  and  Donchln.  E.  The  event-related 
brain  potential  ao  sn  index  c 2  di rpiay-monitoring  workload.  Hunan  Factors 
via  press). 

As  an  lndej'  of  task  workload,  the  possible  advantages  of  the  event- related  brain 
potential  (ERP)  ow.  traditional  secondary  task  and  physiological  measures  era 
described  acd  previous  efforts  to  validate  the  use  of  ERPs  in  this  context  are 
discussed.  An  experiment  is  then  reported  in  which  perceptual  load,  incurred  by 
monitoring  a  simulated  air-traffic  control  display  for  discrete  events,  is  assessed 
using  (s)  measures  of  the  P3CG  component  of  ERPs  elicited  by  auditory  probe  stimuli, 
and  (b)  a  reaction  time  secondary  task.  Ths  ERP  measures  ware  found  to  reflect 
systematically  differences  in  task  workload  and  to  vary  in  agreement  with  the 
reaction  time  measure.  The  results  are  discuss''  i  within  the  framework  of  a  multi¬ 
dimensional  conception  of  human  processing  resources  and  task  workload. 

W/L  Cat.  Coda:  2.2.1,  3.1.  4.1.6 

Op.  Behav.  Code:  2  .2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  Experimental  Laboratory  Flight  simulator 

Primary  task  Single  measures 

Ph8ylological  ECP 
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Israal,  J.  B. ,  Wlckans,  C.  D. ,  and  Donchln,  E.  The  avant-ralatad  brain 
potantial  aa  a  aalactiva  Indax  of  display  load.  Procaedinga  of  tha  23rd 
Annual  Masting  of  tha  Hunan  Factors  Socisty.  Octobar  29-Movambar  1.  1979, 
Boston,  Naaaachuaatta,  55S-562. 

Aa  an  indax  of  task  workload,  tha  posslbla  advantagaa  of  thr  avant-ralatad  brain 
potantial  (EBP)  over  traditional  aacondary  task  taehniquaa  and  paychophyaiologlcal 
msasurws  ara  dascrlbad  and  previous  efforts  to  validate  tha  use  of  ERPa  lu  thla 
context  ara  discussed.  A  series  of  six  experiments  is  than  reported  in  which  the 
affects  of  tracking  difficulty  and  display-monitoring  load  manipulations  on 
secondary- task  reaction  tine  and  ERP  measures  are  compared.  The  results  are 
interpreted  within  the  framework  of  a  "multiple  reservoir"  conception  of 
processing  resources  and  task  workload. 

W/L  Cat.  Code:  2.2.1,  3.1,  4.1.6 

Op.  Behav.  Code;  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  Laboratory  Flight  simulator 

Primary  tasic  Single  measures  Experimental 

Physiological  EC P 


Ivanov-Muromskii,  K.  A.  and  Lukianova,  0.  N.  Man  in  the  state  of  operational 
stress.  Fiziologila  Cheloveka,  1975,  1.,  459-568.  (In  Russian.) 

The  paper  investigates  the  activity  and  functional  state  of  individuals  under 
conditions  of  operational  stress  Induced  by  time  deficit  in  carrying  out  a  number 
of  algebraic  operations.  Best  results  are  obtained  by  the  testers  characterized 
by  a  high  lability  of  nerve  processes.  In  the  case  where  the  operation  Is  carried 
out  under  conditions  of  sound  noise,  selection  of  operator  requires  an  individual 
with  a  high  lability  and  with  a  high-intensity  nervous  system  with  respect  to 
stimulation.  Human  stress  condition  is  shown  to  entail  changes  In  functional 
state,  which  is  reflected  in  a  substantial  change  in  the  parameters  of  different 
systems  in  the  human  body* 

W/L  Cat.  Code:  2.1.1,  3.1,  4.1 

Op.  Behav.  Code:  1.,  2. 

Spare  m.  capacity  Multiple  Experimental  Laboratory  Flight  simulator 

Primary  task  Construct 

Physiological 
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Jahni,,  D.  W.  Operator  workload:  What  la  It  and  how  should  it  be  massured? 

In  K.  D.  Croaa  and  J.  J.  McGrath  (Ida.)  Crew  System  Design.  Santa  Zerbara, 
California::  Anacapa  Sciences,  J*ily,  1973. 

The  tarn  "operator  workload”  generally  refers  to  an  integrative  concept  for 
evaluating  the  effects  or  the  human  operator  associated  with  the  multiple 
stressea  occurring  within  nan-machine  operating  environments.  Viewing  the 
human  operator's  role  In  nan-machine  systaaa  as  that  of  an  Information  transfer 
and  transformation  component,  a  case  is  made  for  considering  workload  as 
consisting  of  three  functionally  relatable  aspect*:  Input  load,  operator 

auu  a  \uul l •  huiuOM  measuring  techniques  having  their  basis  In 

time-and-motion  analyser,  information  processing  experiments,  and  direct 
physiological  measurement  of  the  operator  state  are  briefly  discussed.  The 
initial  conceptualizations  of  a  long-range  research  program  are  indicated, 
where  the  objective  Is  the  systematic  investigation  of  operator  effort  exerted 
relative  to  specifiable  input  loads  and  performance  criteria. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiple  Review  None  Flight  simulator 

Spare  m.  capacity  Flight  test 

Primary  task 
Physiological 


Jahns,  D.  W.  A  concept  of  operator  workload  in  manual  vehicle  operations. 
Meckenheim,  Germany:  Forschungsinstitut  fur  Anthropotechnik,  Report  No. 
14,  1973. 

A  conceptual  structure  (or  model)  of  operator  workload  relying  on  the  data 
available  in  workload  literature  is  presented.  The  Interrelationships  among 
various  workload  assessmant  techniques  including  time-and-motion,  information 
processing,  operator  activities,  and  equipment  design  studies  are  pointed  out 
systematically.  It  is  concluded  that  each  of  the  aspects  of  workload:  input 
load,  operator  effort,  and  work  result,  must  be  quantitatively  sculed  before 
the  complex  problem  of  task  interference  and  crew  system  design  criteria  In 
vehicle  operations  can  be  treated  comprehensibly. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1. ,  2. ,  4. 

Opinion  Multiple  Review  None  Flight  simulator 

Spare  m.  capacity  Flight  test 

Primary  task 
Physiological 


143 


SY-27R-A0 


Jannay,  L.L.,  Older,  h.J.  and  Canaron,  B.J,  Measurement  of  operator  workload 
In  an  InfovnaCion  pro  cawing  teak.  Washington,  D.C.:  National  Aeronautics 
and  Space  Administration,  Contractor's  Report  NASA  CR-2150,  Dacambar,  1972. 

This  was  an  experimental  study  to  davelop  an  lnproved  methodology  for  measuring 
workload  In  an  Information  processing  task  and  to  assess  the  effaces  of  shift 
langth  and  communication  density  (rate  of  information  flow)  on  the  ability  to 
process  and  classify  verbal  aeaeagac.  Each  of  twalva  aubjecte  was  expos ad  to 
combinations  of  three  shift  lengths  and  two  coonunication  denaltlaa  in  a  counter- 
balanced,  repeated  measurements  experimental  design.  In  addition  to  taak-epaciflc 
measures,  subjects  were  administered  e  battery  of  perceptual -motor,  cognitive 
and  sanaory  teats  on  a  pra-  and  poat-ahlft  basis.  Physiological  measuraa  and 
subjective  magnitude  estimates  of  three  workload  variables  wars  eleo  obtained. 
Results  indicated  no  systematic  variation  in  task  performance  measures  or  in 
othsr  dependent  measures  as  a  function  of  shift  le.igth  or  communication  density 
This  is  attributed  to  the  absence  of  a  aacondary  loading  teal  ,  an  insufficiently 
taxing  work  schedule,  end  the  lack  of  psychological  stress.  Subjective  magnitude 
estimates  of  workload  shoved  fatigue  (and  to  a  lesser  dagrae,  tension)  to  be  a 
power  function  of  shift  langth. 

W/L  Cat.  Coda:  1.1,  2.2,1,  4.1.1,  4.1.10 

Op.  Behav.  Coda:  1.,  2.,  3. 

Opinion  Rating  acala  Experimental 

Spare  m.  capacity  Subsidiary  taak 

Physiological  Heart  rata , 

h.r.  var. 


Jennings,  A,  K.  and  Chiles,  W,  0.  An  investigation  of  time-sharing  ability 
a*  a  factor  in  complex  performance.  Human  Factors.  1977,  19,  535-547. 

Thirty-nine  men  wars  tested  on  a  total  cf  six  tasks;  performance  was  measured 
on  each  taak  presented  individually  and  on  two  complex  taske  made  up  of  three- 
taak  subsets.  A  factor  analyitla  performed  on  the  resultant  data  revealed  a 
factor  that  showed  high  loadings  for  two  different  monitoring  tasks  for 
complex  performance  but  negligible  loadings  for  these  t  i»k«  for  simple 
performance;  asperate,  orthogonal  factors  were  found  for  the  two  monitoring 
tasks  when  thay  ware  performed!  under  almple-taak  conditions.  The  monitoring 
measures,  thus,  appear  to  posses*  properties  that  would  b*  expected  of 
measures  of  a  time-sharing  ability, 

W/L  Cut.  Coda:  2.2.1,  2.2.3,  3.1 

Op,  Behav.  Coda:  l,,  2.,  4. 

Spare  m.  capacity  Subsidiary  taak  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Laboratory  Flight  simulator 
Flight  test 
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Jex,  H,  R.  Two  applications  of  a  critical-instability  taak  to  secondary  wprk 
load  research.  I8SE  Transactions  on  Human  Factors  in  Electronics,  1967 » 

HFK-8.  279-282. 

This  exploratory  application  of  the  critical  taak  concepts  to  the  secondary 
workload  problem  results  In  the  following  sain  conclusions.  1)  A  subcritical 
task  makes  an  easily  quantifiable  secondary  task,  whose  at tent ion «1  demand 
(measured  by  secondary  control  activity)  is  directly,  but  not  linearly, 
related  to  the  degree  of  instability.  2)  The  autopaccd  crttlcal  task  score 
decreases  with  increasing  secondary  task  Instability,  and  may  be  used  as  an 
alternative  index  of  the  secondary  task  loading.  J)  Three  very  experienced 
pilots  (astronaut  candidates)  all  shoved  similar  decrements  in  performance 
with  secondary  task  instability,  implying  that  the  effects  talght  be  standardised. 
A)  There  was  evidence  cf  discrete  control  actions  and  display  scanning,  but  the 
onset  of  secondary  control  changes  aaemed  moro  related  to  the  secondary  task 
error  rate  and  direction  rather  than  the  error's  magnitude  or  ne&rness  to 
the  display  limit.  The  gross  control  motion  was,  nevertheless,  proportional 
to  the  delayad  error,  es  predicted. 

W/L  Cat.  Code:  2.2.2,  3.1 

Op.  Behav.  Code:  1.,  A. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Jex,  H.  R.  A  proposed  set  of  standardized  sub-critical  tasks  for  tracking 
workload  calibration.  In  N.  Moray  (Ed.)  Mental  workload;  its  theory  and 
measurement .  New  York:  Plenum  Press,  1975,  179-188. 

A  set  of  subcritical  tracking  tasks  are  proposed  as  one  portion  of  a  future 
standardized  battery  of  different  types  of  tasku,  eech  having  graded  levels  of 
mental  workload,  again&t  which  various  investigators  could  calibrate  and 
validate  their  measures  of  workload.  This  paper  provides  the  recommended  task 
description,  mechanization,  inputs,  operating  procedures  and  evaluation  criteria 
so  that  measurements  mads  in  different  locations  can  be  validly  mads. 


w/L  Cat.  Code: 

2.2,5.  3.3. 

Op.  Behav.  Code: 

1.,  2..  A. 

Spars  m.  capacity 

Adaptive  tracking  Construct 
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Flight  simulator 

Primary  taak 

Flight  CA6K 
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Jex,  H.  R.  and  Alien,  R.  W.  Research  on  a  new  human  dynamic  response  test 
battery.  Part  I.  Test  development  and  validation.  Proceedings  of  the  6th 
Annual  HASA-Oniversity  Conference  on  Manual  Control,  Wright-Pat terson  APB, 
Ohio,  April,  1970,  743-766. 

A  battery  of  autopaced  critical-instability  tasks,  subcritical  tracking  tasks, 
and  step  reactlop-tiue  tests  vae  developed  to  permit  efficient  measurement  of 
the  limiting  human  dynamic  response  properties.  Standard  test  parameters  for 
first-,  second-,  and  third-order  controlled  elements  (the  latter  requiring 
double  load  equalisation)  are  gxven.  Comprehensive  "baseline"  measurements 
were  made  on  four  well-trained  subjects  (three  were  pilots)  using  a  specially 
built  Controlled  Element  Computer  and  an  on-line  Describing  Function  Analyzer. 
The  resulting  data  includes:  tracking  errors,  describing  functions  (and  derived 
loop  closure  and  model-fitting  parameters) ,  remnant,  critical  instabilities, 
and  rsaction  times.  Rwaarkably  simple  correletionn  are  shown  between  the 
critical  instability  and  various  other  closed-loop  dynamic  performance  metrics. 
Thece  tests  and  results  constitute  the  foundation  for  a  series  of  continuing 
experiments  on  effects  of  environmental  ctrcssea  and  workload. 

W/L  Cat.  Code:  2.2.5,  3-2,  3.3 

Op.  Behav.  Code:  1. ,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Math,  model  Flight  teat 


Jex,  tt.  k.  and  Allen,  F..  W.  Research  on  a  nev  human  dynamic  response  test  battery. 
Part  II.  Paychophyaiological  correlates.  Proceedings  of  the  6th  Annual  HA3A- 
University  Conference  on  Manual  Control.  Wright-Pat tersoc  AFB,  Ohio,  April, 

1970,  767-777. 

During  a  comprehensive  set  of  tracking  tasks  for  three  orders  of  controlled 
element  with  four  trained  subjects  (reported  separately) ,  a  number  of  simulta¬ 
neous  paychophyaiological  measurements  were  taken.  These  included:  electro¬ 
cardiogram,  "instantaneous"  heart-rate,  breath  flow,  electromyograms,  average 
grip  pressure,  and  palmar  skin  resistance.  These  data  showed  consistent  increases 
in  the  neuromuscular  tension  indicators  during  tracking.  Breathing  was  usually 
faster  and  shallower.  The  average  heart  rate  increased  for  only  two  of  the  four 
subjects,  but  distinct  increases  in  the  cardiac  "sinus  arrhythmia"  were  noted, 
which  were  completely  correlated  with  breath  flow. 

W/L  Cat.  Code:  4,1.2,  4.1.3,  4.1.4,  4.1.9,  4.1.10,  4.1.11 

Op.  Behav.  Cede:  1.,  2.,  4. 

Phyrioio^ical  Multiple  Experimental  Laboratory  Flight  simulator 

Flight  test 
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Jex,  H.  E.  and  Clamant  t  W.  F, *  Defining  and  measuring  perceptual-motor  load 
In  manual  control  tasks.  In  H.  Moray  (F.d.)  Mental  workload i  Its  theory 
and  measurement.  New  York:  Plenum  Press,  1979,  125-177. 

Basle  concepts  for  defining  and  measuring  the  'Ucntal  workload"  in  simple  and 
complex  tracking-type  tasks  are  reviewed.  The  basic  concept  le  that  subjective 
mental  effort  can  only  be  meaningfully  defined  in  terus  of  Its  margin  with 
respect  co  some  form  of  control-workload  limit.  The  internal  allocation  of 
attentlonal  resources  to  maximize  the  margin  of  capacity  la  assumed  to  be  under 
the  control  of  a  supervisory  "meta-control-system. "  Means  for  measuring  the 
"excess  control  capacity"  are  described  (especially  the  Critical  Instability 
Task  and  Cross-Coupled- Instability  Task),  and  their  application  to  workload 
research  and  practical  evaluations  of  pilot/vehicle/dlsplay  systems  is 
3tmmarlzed.  Extensions  to  discrete  task  workload  are  discussed,  along  with 
implications  of  sampling  errors  on  task  workload  and  performance.  Some  examples 
of  p8ychophyslological  measures  during  tracking  tasks  are  given. 

W/L  Cat.  Code:  l.t  2.,  4. 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Multiple  Review  Laboratory  night  simulator 

Spare  m.  capacity  Flight  test 

Physiological 


Jex,  H.  R. ,  Jewell,  W.  F.  and  Allen,  R.  W.  Development  of  the  dual-axis  and 
cross-coupled  critical  tasks.  Proceedings  of  the  Eighth  Annual  Conference 
on  Manual  Control,  University  of  Michigan,  Ann  Arbor,  Michigan,  May  197°., 

Multiaxis  offspring  of  the  well-established  single-axis  Critical  Instability 
Task  are  described.  The  Dual-Axis  Critical  Task  requires  the  operator  to 
stabilize  simultaneously  two  identical,  increasingly  unstable,  controlled 
elements  (one  in  each  axis) ,  using  identical  control  and  display  gains.  The 
dual-axis  score,  X^,  is  the  level  of  instability  at  which  control  is  lost 
in  either  axis.  Pilot  experiments  show  that  Xj)  is  a  sensitive  Indicator 
of  display  format  and  control  stick  ef ft  :ts.  The  Cross-Coup led-Inrtabillty 
Task  involves  any  arbitrary  primary  control  task  (which  may  itsexf  be  multiloop), 
with  a  "subcritical"  secondary  task  whose  instability  level  is  adaptively  cross- 
coupled  to  the  primary  task  performance  index.  The  cross-coupled  scoie,  >-x» 
is  the  asymptotic  level  of  secondary  task  Instability,  which  is  shewn  to  be 
sensitively  related  to  the  ettentional  workload  margin  of  the  primary  tack. 

Subtle  initializing  and  adaptive  .logic  were  needed  to  permit  a  single 
mechanization  to  handle  a  wide  variety  of  primary  tasks  acd  individual  skill 
levels.  Some  early  applications  of  these  tsks  are  reviewed. 

W/L  Cat.  Code:  2.2.5,  3.1 

Op.  Behav.  Coda:  1-,  2., 

Spare  m.  capacity  Subsidiary  Josk  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures 


Jex,  3.R. ,  McDonnell.  .i,D,  and  Phatak,  A.V.  A  "critical"  tracking  taak  for 
man-machine  research  related  to  operator's  effective  delay  time.  Proceedings 
of  the  2nd  Annual  HASA-Univeralty  Conference  on  Manual  Control,  Massachusetts 
Institute  of  Technology,  March  1966,  361-377.  (NASA-SP-128) . 

A  closed-loop  compensatory  tracking  task  has  bean  developed  which  yields  a  measure 
of  the  human  operator's  time  delay  characteristics  while  tracking,  constrains  his 
behavior  to  within  very  narrow  limits,  and  provides  a  low  variability  Indicator 
oi  the  operator's  tracking  ability.  The  procedure  is  called  the  critical  task 
because  the  operator  is  required  to  stabilise  an  increasingly  unstable  controlled 
element  up  to  the  critical  point  of  loss  of  control.  Based  on  recent  human 
response  research,  a  theoretical  analysis  of  this  man-machine  system  la  performed, 
and  the  results  of  an  experimental  program  are  described,  which  enables  describing 
function  and  critical  task  measures  to  be  compared.  An  "autopaced"  critical  task 
mechanization  and  operating  procedure  is  described  which  yields  consistent,  reliable, 
and  very  low  variance  measurements  of  the  critical  levels  of  instability.  An 
analysis  of  the  measured  human  operator  describing  functions  shows  that,  when 
operating  near  criticality,  the  subject's  behavior  is  adequately  represented  by 
the  most  recent  human-operator  describing-function  models  and  adaptation  laws. 


W/L  Cat.  Code: 

2.2.5,  3.3 

Op.  Behav.  Code: 

1.,  2.,  4.2 

Spare  m.  capacity 

Subsidiary  task 

Construct  Laboratory 

Flight  simulator 

Primary  task 

Math,  model 

Experimental 

Johannsen,  G.  Nebensufgaben  als  Beanspruchungsmessverfahren  in  FahrzeugfUhrungsauf- 
geben.  Zeltschrift  ftlr  Arbeit swissenschaf t ,  1976,  310,  45-50. 

A  conceptual  differentiation  between  input  load  and  operator  effort  is  stated. 
Workload  measures  are  contrasted  to  the  performance  measures.  Methods  for 
workload  measurement  are  classified.  Secor.dary  tasks  for  workload  measurement 
are  dealt  with  extensively  and  marginal  conditions  are  explained  which  have  to 
be  considered  in  using  secondary  tasks.  Examples  given  for  secondary  tasks 
are  the  tapping  task,  choice  reaction  tasks  and  cross-adaptive  secondary  tasks. 
Recent  results  using  the  tapping  task  as  workload  Indicator  in  simulated  6  (grad) 
landing  approaches  are  presented.  The  irregularity  in  tapping  increases  more, 
when  the  primary  task  gets  more  difficult. 


W/L  Cat.  Code:  1.2.,  3*1 

Op.  Behiv.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  Flight  simulator  Flight  simulator 
Primary  task  Single  measures  Experimental  Flight  teat 
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Johannaen,  G.  Workload  and  workload  measurement.  In  N.  Moray  (Bd.)  Mantal 
workload;  lta  thaory  and  application.  Maw  York:  Plenum  Prats ,  1979,  3-11, 

Workload  la  defined  and  various  measures  are  daaalfled  In  tarew  of  t law- line 
analyale,  information  proceaaing,  operator  activating-level,  and  subjective 
effort  ratinga.  An  application-oriented  procedure  of  workload  aaaecswent  and 
relatlonahipa  among  measuring  technique a  are  preaented. 


W/L  Cat.  Code: 

Op.  Be’  ?  de: 

1.,  2.,  3,,  4. 

1.,  2.,  4. 

Opinio  k. 

Spa^j  m.  capacity 

Primary  task 

Physiological 

Mul tiple 

Review 

None 

Flight  simulator 

Flight  test 

Johannaen,  G. ,  Pfendler,  C.  and  Stein,  W.  Human  performance  and  workload  in 
simulated  landing-approaches  with  autopilot-failures.  In  T.  B.  Sheridan 
and  G.  Johannaen  (Eds.)  Monitoring  behavior  and  supervisory  control. 

New  York:  Plenum,  1976,  83-95. 

A  fixed-based  simulator  of  a  small  STOL-ulrcraft  was  used  to  aaeeaa  a  simulated 
inat rumen t-landing-syatem  (ILS)  with  autopilot  failures  of  a  stability 
augmentation  system  (SAS) .  Varloua  control  and  monitoring  task  configurations 
were  evaluated  in  terms  of  pilot  workload  measures  and  deviations  from  glldepath. 
Both  subjective  pilot  ratings  on  a  five  point  workload  rating  (WLR)  and  a 
tapping  task  for  perceptual  motor  load  (PML)  were  used  to  assess  workload.  The 
results  showed  reduced  performance  and  Increased  workload  Immediately  after 
failure  detection  and  manual  take  over. 

W/L  Cat.  Code:  1.1,  2.2.2 

Op.  Behav.  Code:  1.1,  2.2,  4.2 

Opinion  Rating  scale  Experimental  Flight  slaulator  Flight  simulator 

Spare  m.  capacity  Subsidiary  task  Flight  teat 
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Johnston,  D.  *..  KUln,  R.  H. ,  and  Hoh,  R.  H.  Manual  and  automatic  flight 
octroi  during  eeyar#  turbulence  penetration.  Hawthorn*,  California t 
Systems  Tachnology,  Inc.  TR-1049-1 ,  (Pinal  Sepbtt,  NASA— CR-2677) ,  April,  1976. 

An  analysis  and  experimental  investigation  of  possible  contributing  factors  in 
jet  aircraft  turbulence  upsets  was  conducted.  Major  contributing  factors  identified 
included  autopilot  and  display  deficiencies,  the  large  aircraft  inertia  and 
associated  long  response  tins,  and  excessive  pilot  workload.  An  integrated  flight 
and  thrust  energy  management  director  syutem  was  synthesised.  The  system  was 
Incorporated  in  a  aoving^basa  siaulation  and  avaluatad  using  aapariancad  alrllna 
pilots.  Th*  avaluation  included  comparison  of  pilot  workload  and  flight  per¬ 
formance  during  severe  turbulence  penetration  utilizing  four  control/display 
concepts.  Simulation  results  show  improved  performance,  re  !  pilot  workload, 
and  a  pilot  preference  for  an  autopilot  system  controlling  to  ~  flight  director 
coastand,  and  manual  control  of  thrust  following  the  trim  thrust  director. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 

Opinion 

Primary  task 


1.1,  3.1,  3.3 
1.,  2.,  4. 

Rating  scale  Construct  Flight  simulator  Flight  simulator 
Single  measures  Experimental  Flight  test 

Math,  model 


Jones,  E,  C.,  Jr.  and  Schuster,  D.  H.  Design  and  development  of  an  adaptive, 
auditory,  and  diatractive  stressor.  IEEE  Transactions  on  Man-Machine  Systems, 
1970,  MMS-11.  161-163. 

An  auditory,  distractive  stressor  was  developed  that  automatically  edjustc 
its  rate  of  presenting  random  digits  to  human  subjects.  The  rate  of  digit 
presentation  serves  as  an  inverse  index  of  the  amount  of  attention  the 
subject  can  spare  from  a  primary  task,  such  as  driving  a  simulated  car.  The 
auditory  pattern  recognition  of  the  uevice  was  evaluated  under  several  speaking 
conditions  and  for  a  variety  of  lumen  speakers.  The  distractive  stressor  has 
a  satisfactory  digit  recognition  accuracy,  and  consequently  adepts  its  digit 
presentation  rate  quickly  according  to  how  well  a  subject  repeats  its  given 
numbers . 


W/L  Cat.  Code:  2.2.4 

Op.  Behav.  Code:  2.1,  4.2 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
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Joslin,  R, ,  Ohmiya,  H.f  and  Kills,  D.  K.  A  study  of  simplified  methods  for 
longitudinal  control  dacoqtll&i.  Society  of  Automotive  Engineers,  Reprint 
water  770468,  March,  1977. 


Using  an  inflight  simulator,  a  staple  longitudinal  decoupling  concept  was  compared 
with  conventional  airplane  characteristics  for  the  approach  and  landing  tasks. 

The  decoupling  system  allowed  the  pilot  to  cooand  /'light  path  ac&la  changea  with 
the  stick  with  little  or  no  aceoapanylng  speed  change;  likewise,  speed  changes 
with  only  small  accompanying  flight  path  changes  could  be  made  with  throttle  only. 
The  unique  feature  of  the  concept  is  that  it  is  an  open  loop  control  system. 
Results  indicate  that  in  calm  «ir  fud  up  to  moderate  levels  of  turbulence  the 
decoupling  system  provides  <*  suv '  ;  reduction  in  pilot  workload. 

H/L  Cat.  Code:  1.1,  3.1 


Op.  Bete*.  Code: 
Opinion 
Primary  task 


1.,  2.,  4.2 


Rating  scale  Experimental 
Single  measures 


Flight  test  Flight  simulator 
Flight  test 


Juris,  M.  and  Velden,  M.  The  pupillary  response  to  mental  overlaod. 

Physiological  Psychology.  1977,  5,  421-424. 

The  hypothesis  that  the  pupil  constricts  below  base  level  in  situations  of  mental 
overload  was  tested.  Subjects  had  to  par fore  in  a  four-alternative  forced-choice 
task  at  75X,  100X,  and  125Z  the  speed  of  their  maximum  processing  capacity.  No 
indication  of  a  pupillary  constriction  in  the  overload  situation  was  found  The 
pupil  dilated  under  all  three  conditions.  The  pupil  diameter  of  male  subjects 
significantly  decreased  after  the  sharp  Increase  at  the  beginning  of  the 
experimental  phases,  while  th«  female  subjects'  pupil  disaster  remained  at  the 
same  level  after  the  initial  Increase.  The  amount  of  dilation  depended  on 
information  loud  for  rale  subjects  only. 

W/L  Cat.  Code:  4.1.8 

Op.  Behav.  Code:  1.,  2.,  4.1 

Physiological  Pupillary  dla.  Experimental  Laboratory  Flight  simulator 

Flight  test 
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Kahnaman,  D.  Attention  end  effort.  Englewood  Cliffs,  M«w  Jersey*  Prentlc*- 
Hell,  Inc. ,  1973. 

This  book  deals  with  the  oasic  Issues  in  the  study  of  attention  and  effort. 
Chapter  1  describes  an  integration  of  the  intensive  and  selective  aspects  of 
attention.  Chapter  2  and  3  discuss  sons  intensive  aspects  of  attention  and 
elaborate  on  the  capacity  model  of  attention  and  mental  effort.  Chapter  A  is 
devoted  to  looking  behavior.  Some  variants  of  selective  attention  are  discussed 
in  Chapter  5,  which  presents  a  model  of  the  role  of  attention  in  perception.  A 
brief  review  of  attention  to  attributes  in  Chapter  6  la  followed  by  a  more 
thorough  review  of  focused  end  divided  attention  with  simultaneous  inputs 
(Chapters  7  and  8).  The  division  of  attention  between  simultaneous  or 
immediately  successive  speeded  responses  13  discussed  in  Chapter  9.  Chapter 
10  returns  to  the  concept  of  effort  and  its  measurement  by  task  Interference. 


W/L  Cat.  Code: 

Op.  B-sViv.  Code: 
Spare  m.  capacity 
Primary  task 


2.2,  3.1 

1.,  2. 

Subsidiary  task  Review 
Single  measures  Construct 

Experimental 


Laboratory 


Background 


Kahneraan,  £.,  Beatty,  J.  and  Pollack,  1.  Perceptual  deficit  during  a 
mental  task.  Science,  1967 t  157,  218-219. 

Subjects  monitored  for  a  visual  signal  while  engaged  in  a  demanding  mental 
task.  The  probability  of  detecting  the  signal  depends  on  the  time  of  its 
presentation  during  the  8  seconds  of  the  task.  A  similar  time  course  in 
observed  for  failures  to  detect  and  for  changes  of  pupil  sise.  Momentary 
variations  in  the  load  that  the  task  Imposes  on  the  subject  are  reflected 
in  both  Indices.  Detection  failures  are  not  explained  by  the  pupillary 
changes . 

W/L  Cat.  Code:  2.2.1,  A. 1.8 

Op.  Behav.  Code:  1.,  2.,  A.l 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Physiological  Pupillary  dia.  Flight  test 
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Kahasman,  D.,  lurakjr,  1. ,  Shapiro,  D.  and  Crldar,  1.  Pupillary,  ha  art  ta£a, 
and  akin  ’salat an ca  changaa  during  e  aartal  taak.  Journal  of  fnparlmantal 
ParcViolcay,  1969  ,  7£,  164-167. 

Subject*  performed  a  pacad  mental  taak  at  thraa  leva Is  of  difficulty,  whilo 
t T,ms- locked  recordings  of  pupil  diameter,  heart  rata,  end  skin  resistance 
were  made.  A  similar  pattern  of  syvpathetlcllka  Increase  was  found  In  the 
thraa  autonomic  functions  during  information  Intake  and  processing,  followed 
by  a  dacreaaa  during  the  report  phase.  The  peak  respites  in  each  measure 
wee  ordered  an  a  function  of  taak  difficulty. 

W/L  Cat.  Coda:  4.1.2,  4.1.8*  4.1.10 

Op.  Behav.  Code:  2. 

Physiological  GSR  Experimental  Laboratory  Plight  simulator 

Pupillary  dla. 

Heart  rate, 
h.r.  var. 


Kalsbeek,  J.  W.  H.  Objective  measurement  of  mental  workload:  Possible 

applications  to  the  flight  taak.  Proceedings  of  the  55th  AGARD  Conference, 
Amsterdam,  The  Netherlands,  1968,  4.1  -  4.6. 

Methods  and  techniques  are  developed  and  applied  in  simulation  experiments 
to  evaluate  cockpit  worklo&d.  Heart  beat  Irregularity  patterns  are 
scored  as  a  function  of  the  number  of  signals  per  minute  answered  by  six 
subjects  in  a  laboratory  teat  situation.  Distraction  stress  Is  evaluated  in 
relation  to  the  step-by-step  disintegration  of  writing  performance.  A 
description  is  given  of  the  mental  task  simulator  which  Is  applied  to 
cockpit  design. 

W/L  Cat.  Code;  4.1.10,  4.1,13 
Op..  3ehav.  Cede:  1.,  2. 

Physiological  Heart  rats  Experimental  Laboratory  Flight  simulator 
h.r.  var. 

Handwriting  Flight  test 

anal. 
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Kalsbsek,  J.  W.  R.  Mm ir— aiit  of  mental  work  load  and  of  acceptable  load: 
Poaalbla  applications  in  Industry.  International  Journal  of  Production 
Research,  1969,  33-45, 

In  tha  uiUHMnr  of  mental  workload  in  which  consideration  o?  human  hrain 
as  an  input-output  system  of  information-handling  is  a  prerequisite,  the 
effect  of  the  central  choice  making  system  being  the  weakest  link  is 
demonstrated,  using  a  binary  choice  generator.  It  was  found  that  increasing 
tha  number  of  binary  choices  per  minute  diminished  the  irregularity  of  the 
rest  pattern  (sinus  arrhythmia)  without  affecting  the  level  of  heart  rate. 

A  simple  scoring  method  for  the  use  of  sinus  arrhythmia  is  put  forward  and 
different  tasks  are  scaled  according  to  the  progressive  suppression  of  sinus 
arrhythmia . 

W/L  Cat .  Coda:  4.1.10 

Op.  Bshsv.  Code:  2. 

Physiological  heart  rate  Experimental  Laboratory  Flight  simulator 

h.v.  var. 


Kalsbeek,  J.  W.  H.  Standards  of  acceptable  load  in  ATC  tasks.  Ergonomics . 
1971,  14,  641-650. 

Mental  load  in  ATC  tasks  is  described  as  the  brain  controlling  the  controller's 
controlling  performance .  A  moment  of  conscious  brain  control  is  put  forward 
as  a  unit  to  quantify  this  kind  of  mental  load.  New  action  programs  ere 
supposed  to  require  conscious  brain  control  at  every  step  of  their  execution; 
with  routine  this  would  be  less  and  less  the  case.  The  duration  of  a  morse t 
of  conscious  control  varies  according  to  the  complexity  of  the  control  to  be 
exercised  and  tha  number  of  considerations  whicn  have  to  be  taken  into  account. 
Propositions  are  made  on  hew  to  think  about  selective  attention,  identification 
and  cognitive  processes  in  terms  of  executing  programs.  A  job  description 
method  is  put  forward  in  terms  of  such  executing  programs.  Why  moments  of 
conscious  brain  control  as  units  are  more  suited  to  the  problem  of  mental  load 
then  are  units  like  bits,  choices  and  decisions  is  discussed.  Experiments  are 
described  with  physiological  and  psychological  variables  as  a  function  of  the 
number  of  moments  of  conscious  brain  control  per  minute. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  l.,  2.,  4. 

Spare  m.  capacity  Task  comp..  Construct  None  Flight  simulator 

time  assess. 
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Kalsbeek,  J.W.H.  Do  you  believe  in  sinus  arrhythmia?  Ergonomics .  ’973,  16, 
99-104. 

Problems  r ala yd  by  fchs  uss  of  heart  rats  Irregularity  as  a  dependent  variable 
In  experiments  are  described.  Referring  to  experimental  results  It  Is  argued 
that  mental  load  is  not  an  Indivisible  concept.  In  laboratory  studies  a  binary 
choice  task  le  often  used  to  provide  the  level  of  mental  load  as  an 
Independent  variable.  Thlc  kind  of  task  la  dependent  on  the  capacity  of  the 
single  channel  function.  Other  types  of  informational  load  are  conceivable. 
Special  attention  Is  given  to  the  phenomenon  of  peak  load.  Finally,  heart  rate 
variability  is  accepted  ea  an  indicator  of  the  proportional  occupation  of  an 
individual's  single  channel  capacity  during  rest  and  work.  A  plea  is  made  that 
It  la  necessary  to  be  very  careful  In  using  terns  like  the  sinus  arrhythmia  and 
the  mental  load  and  in  ui/.lng  heart  rate  variability  in  field  applications. 

W/L  Cat.  f’cda:  4.1.10 

</p.  Bahsv.  Code:  1.,  2,,  4. 


Physiological  Heart  rate.  Review  None 

h.r.  var. 


Flight  simulator 
Flight  test 


Kalsbeek,  J.  W.  H.  Sinus  arrhythmia  and  the  dual  task  method  in  measuring 
mental  load.  In  V.  T.  Singleton,  J.  G.  Fox,  and  D.  Whitfield  (Eds.) 
Measurement  of  Man  at  Work.  London:  Taylor  and  Francis,  1973,  101-113. 

The  heart  rate  pattern  of  normal  healthy  subjects  sitting  at  rest  is  Irregular 
Momentary  irregularity  of  up  to  ten  or  fifteen  beets  per  minute  can  occur.  In 
the  medical  literature  this  phenomenon  is  generally  referred  to  as  sinus  and 
respiratory  arrhythmia.  If  one  concentrates  one's  attention  on  a  perceptual 
motor  task  the  irregularity  of  tha  heart  rate  pattern  tends  to  disappear  as  a 
function  of  the  number  cf  signals  per  minute  one  has  to  deal  with.  The  mean 
heart  rate,  howevur,  changes  little  if  at  all. 

W/L  Cat.  Code:  2.2,  4.1.10,  4.1.13 

Op.  Behav.  Code:  1. ,  2. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 

Physiological  Heart  rate.  Flight  tent 

h.r.  var. 
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Kalsbaek,  J.W.H.  and  Sykes.  R.N.  Objective  measurement  of  mental  load. 

Acta  Psychologies,  1967,  27,  253-261. 

Two  main  Unas  of  reaaarch  ara  mentioned:  1)  the  detailed  study  of  deterioration 
of  performance  caused  by  what  has  been  called  "distraction  stress";  2)  physio¬ 
logical  measurements  as  functions  of  increasing  quantity  of  Information  handled. 
Regarding  the  first,  a  simple  repetitive  task  serves  to  distract  the  subject  from 
his  carrying  out  a  normal  task  by  occupying  his  Information  handling  capacity. 
Regarding  the  second  line  the  best  physiological  parameter  was  the  scored 
regularity  of  the  heart  rate  pattern.  The  following  aspects  of  the  dual  task 
situation  are  studied:  1)  the  effect  of  training  and  instructions;  2)  the  effect 
of  increasing  demands  in  the  primary  task  in  a  dual  task  situation. 


W/L  Cat.  Code:  2.1.1,  2.2.1,  3.1,  4.1.10,  4.1.13 

Op.  Behav.  Code:  1.,  2.,  4.1 


Spare  a.  capacity  Multiple 
Primary  task 
Physiological 


Experimental  Laboratory  Flight  simulator 

Flight  test 


Kantowitz,  B.  H.  and  Knight,  J.  L. ,  Jr.  Testing  tapping  time-sharing. 

Journal  of  Experimental  Psychology,  1974,  103,  331-336. 

A  Fitts'  law  tapping  task  was  combined  with  a  serial  digit-naming  task  having 
four  levels  of  stimulus-response  complexity.  Baseline  data  were  also  established 
for  tapping  and  naming  tasks  performed  singly.  In  simultaneous-task  p«v romance , 
an  increase  from  3.0  co  10  blta/sec  required  by  the  tapping  task  was  accompanied 
by  a  decrease  in  performance  on  the  naming  task.  When  single-  and  simultaneous- 
task  performance  were  both  analyzed,  an  Interaction  between  tapping  and  naming 
was  obtained,  supporting  a  limited-capacity  channel.  However,  when  only 
simultaneous-task  performance  was  evaluated,  effects  of  tapping  c.id  naming  were 
additive,  supporting  a  stage  model  of  in  >rmation  processing.  Results  stressed 
the  processing  demands  of  a  response  execution  and  control  stage. 

W/L  Cat.  Code:  2.2.1,  2.2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4.1 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 
Primary  task  Single  measures 
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Kantowits,  B.  H.  and  Knight,  J.  L. ,  Jr.  On  experiments-llmited  processes. 
Psychological  Review,  1976,  83,  502-507. 

Norman  and  Bob row  hava  proferred  a  dlatlnctlon  batwaan  data-limitcd  and  resource- 
limit  ad  processes.  This  paper  not«s  sons  limitations  in  the  application  of  their 
framework  to  data,  especially  data  obtained  from  dual-task  timesharing  experiments, 
four  issues  are  discussed:  (a)  the  need  for  single- stimulation  baseline  control 
data,  (b)  problems  in  the  definition  of  data-limited  processes  with  strong  signals, 

(c)  empirical  difficulties  in  distinguishing  movement  along  a  performance  operating 
characteristic  (POC)  from  movement  between  POCs,  and  (d)  the  utility  of  distinguishing 
between  macro-  and  micro-  POCs.  Consideration  of  these  Issues  increases  the 
efficacy  of  Norman  and  Bobrow’s  distinction. 

W/L  Cat.  Code:  2.2,  3.1 


Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


1.,  2.,  3.,  4.1 
Subsidiary  task  Construct 
Single  measures 


None 


Background 


Kantowits,  B.  H.  and  Knight,  J.  L. ,  Jr.  Testing  tapping  timesharing,  II: 
auditory  secondary  task.  Acta  Psychologies,,  1976,  40,  342-362. 

TWo  experiments  were  conducted  to  extend  earlier  time-sharing  results  of  Kantowits 
and  Knight.  The  simultaneous  performsnee  of  a  paced  tapping  task  and  a  digit- 
naming  task  with  auditorally  presented  digits  was  required  in  dual-task  conditions. 
Single-task  conditions  required  only  tapping  or  naming.  When  a  verbal  naming 
response  was  required  (Experiment  1)  additivity  between  tapping  and  naming  was 
obtained  for  single-  vs.  dual-task  comparisons  and  for  dual-task  cosiparisons . 

When  the  naming  response  was  made  by  moving  a  lever  (Experiment  2)  the  additivity 
for  only  dual-task  comparisons  remained  while  an  Interaction  was  obtained  for 
single-  vs .  dual-task  comparisons.  Results  support  a  hybrid  processing  model  with 
serial  and  parallel  arrangements  of  stages. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


2.2.1,  2.2.2,  3.1 
1. ,  2. ,  3. .  4.1 
Subsidiary  task  Experimental 
Single  measures 


Laboratory 


Background 
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Kantowit*,  B.H.  and  Knight,  J.L.,  Jr.  Tatting  tapping  timesharing:  Attantion 
demands  of  covenant  amplitude  and  target  width.  In  G.E.  Stelmr.ch  (Ed  ) 
Information  Proceeding  in  Motor  Learning  and  Control.  New  York:  Academic 
Frees,  197T, 


A  dual  task  methodology  vae  used  to  assess  attention  demands  of  movement 
amplitude  and  target  width  in  a  discrete  target  tapping  task.  The  purpose  was 
to  determine  if  the  secondary  task,  involving  digit  naming  performance,  is 
dependent  upon  the  manner  in  which  the  Index  of  Difficulty  (Fitts)  was 
manipulated.  It  was  found  thst  ths  digit  naming  scores  remained  essentially 
the  same  whether  amplitude  or  width  waa  changed.  It  is  concluded  that  the 
index  of  difficulty  is  s  better  measure  of  af.tantional  demand  than  is  an 
indax  involving  a  number  of  movements. 

W/l  Cat.  Code:  2.2.2,  3.1 

Op.  Behav.  Code:  1.1,  2.1,  4.1 


Primary  task 


Single  measures  Experimental  Laboratory 


flight  simulator 


Spare  m.  capacity  Subsidiary  task 


Flight  test 


Kantowits,  B.  H.  and  Knight,  J.  L. ,  Jr.  When  is  an  easy  task  difficult  and 
vice  versa?  Acta  Psychologic*,  1.978,  42,  163-170. 


Lana  has  argued  that  Kantowl  ?.  and  Knight  incorrectly  predicted  an  interaction 
between  primary  and  secondary  taak  difficulty  for  the  variable-allocation  model 
of  attention.  It  is  shown  that  such  an  interaction  is  indeed  obtained  if  task- 
peiforwance  difficulty  ip  defined  in  terms  of  capacity  and  only  reasonable 
transformations  of  data  are  permitted.  This  interaction  holds  for  any  set  of 
monotorlc  resource  operating  characteristics. 

W/L  Cat.  Code:  2.2,  3.1 


On.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


1.,  2.,  3. ,  4. 

Subsidiary  task  Review 
Single  measures  Construct 


None 


Background 
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K«iley,  C.R.  Design  applications  of  adaptive  (self-adjusting)  simulators. 

Pro  .sad  lugs  of  the  2nd  Annual  NAS A- University  Conference  on  Manual  Control. 
Massachusetts  Institute  of  Technology,  March,  1966,  379-401.  (NASA  SP-128) . 

Adaptive  simulators  have  been  previously  applied  to  problems  of  training.  This 
study  explores  thnir  usefulness  for  manual  control  system  design.  The  history 
and  development  of  the  field  of  adaptive  vehicle  simulation  is  reviewed.  The 
technique  of  adaptation  most  suitable  for  design  studies  is  one  in  which  operator 
performance  is  kept  at  a  preset  criterion  level  by  means  of  adaptive  changes  in 
task  difficulty.  The  performance  criterion  used  to  measure  operator  performance 
is  Important  in  adaptive  as  well  as  non adaptive  simulation.  Tim* -on- target  scores 
were  analyzed  and  found  to  be  excessively  imprecise.  The  recommenced  performance 
criterion  for  many  applications  is  rms  error  in  one  axlr  and  vector  error  in  two 
or  more  independent  axes.  Adaptive  system  changes  are  a  compromise  between  speed 
of  adjusting  to  change  in  operator  performance  and  stability  of  tha  adaptive 
level  achieved.  Example  design  data  are  presented.  The  relation  of  each  design 
variable  to  forcing  function  amplitude,  with  operator  error  constant,  is  described 
for  the  example  task. 

W/L  Cat.  Code:  2.2.4,  2.2.5 

Op.  Behav.  Cod's :  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  flight  simulator 


Kelley,  C.  R.  and  Wargo,  M.  J.  Cross-adaptive  operator  loading  t-nsks.  Human 
Factors .  1967,  j>,  395-404. 

Performance  measures  often  fail  to  indicate  the  amount  of  effort  expended  by  an 
operator  in  reaching  various  levels  of  task  performance.  Secondary  or  loading 
task  techniques  have  been  developed  to  overcome  this  problem.  However,  with  the 
loading  task  technique,  a  problem  of  interpretation  arises  when  both  primary 
and  secondary  task  measures  vary  with  operator  performance.  The  cross-adaptive 
operator  loading  technique,  which  automatically  adjusts  the  difficulty  level 
of  the  loading  task  on  the  basis  of  primary  task  performance,  in  suggested  as  a 
solution  to  thin  problem.  Data  are  presented  which  demonstrate  that  the  cross- 
adaptive  technique  effectively  standardizes  scores  on  the  primary  task  while 
casting  all  the  variance  in  performance  to  the  loading  task  scores.  The  cross- 
adaptive  secondary  scores  thereby  become  a  single  unambiguous  and  sensitive 
index  of  effort  expended  to  reach  a  pre-established  level  of  task  performance. 
Procedures  for  the  implementation  of  the  cross-adaptive  technique,  are  discussed 
and  guidelines  for  its  use  are  suggested. 

W/L  Cat.  Code:  2.2.4,  2.2.5,  3.1 

Op.  Behav.  Code:  1.,  2. t  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures 
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Kennedy,  J.  P.  Time- -sharing  effects  on  pilot  tracking  performance.  Master's 
thesis.  Naval  Postgraduate  School,  Monterey*  California,  September,  1975. 
(AD  A016  378). 

Subjects  were  required  to  perform  simultaneously  &  two-dimensional  tracking 
task  and  respond  to  a  set  of  lights  with  toggle  switches.  Five  levels  of 
difficulty  and  two  stimulus  presentation  rates  were  involved  in  the  secondary 
task.  Thu  purpose  of  the  experiment  wan  to  examine  time-sharing  performance 
of  experienced  military  pilots  and  to  investigate  differences  in  performance 
by  pilots  of  different  types  of  aircraft.  Analysis  of  the  data  collected 
from  20  subjectc  showed  that  correlation  between  elements  of  a  complex  task 
Is  weak,  performance  levels  drop  as  task  load  increases,  and  there  was  only 
one  difference  found  between  any  of  the  pilot  type  groups.  Dual-crew  fighter/ 
attack  jet  pilots  took  significantly  longer  to  respond  to  stimuli  when  time¬ 
sharing. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Kennedy,  R.  S.  Two  procedures  for  applied  and  experimental  studies  of  stress. 

Ft.  Rucker,  Alabama:  U.S.  Army  Aeromedical  Research  Laboratory,  70-11 
NAiJI  1093,  February,  1970. 

To  compensate  for  the  low  reliability  of  physiological  manifestations  of 
sympathetic  nervous  system  activity  two  methods  are  offered.  The  first  method 
requires  a  major  research. program  by  which  a  valid  criterion  of  stress  would  be 
determined  by  experimentation,  and  then  predictors  of  this  criterion  would  be 
obtained  empirically  by  correlational  techniques.  These  predictors  could  then 
be  crossvalidated.  By  using  the  predictors,  the  influences  of  psychological 
stress  and  physiological  stress  could  be  separated.  Whether  a  functional 
relationship  exists  between  the  magnitude  of  the  response  to  stress  and  the 
probability  of  its  occurrence  could  then  be  determined.  The  second  method  is 
similar  but  less  exact.  It  nis  been  used  successfully  in  motion  sickness  studies 
end  avoids  tha  necessity  of  a  long  exploratory  program  with  numerous  pilot  studies. 
A  procedure  for  the  control  and  the  regulation  of  the  perception  of  the  magnitude 
of  the  stress  to  the  organism  (human  and  infrahuman)  is  offered  for  use  with  the 
two  methods.  The  lack  of  suitable  control  of  this  factor  is  discussed  in 
connection  with  previous  research. 

W/L  Cat.  Code:  4. 1 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Multiple  Construct  None  Flight  simulator 

Flight  test 
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Kennedy,  R.  S.  Bioelectric  Indicant*  of  diver's  ability  to  perform  useful  work. 
Paper  presented  at  the  Undersea  Medical  Society  Workshop,  Bethesda,  Maryland, 
March,  1978.  (AD  A060  675). 


In  the  future  increasing  demands  will  be  made  of  the  diver  for  Information  pro¬ 
cessing  and  decision  making.  It  was  hypothesized  that  a  neglected  indicant  of  an 
operator's  ability  to  perform  useful  work  in  air  is  eye  movement  activities.  It 
was  felt  that  aspects  of  oye  movements  could  provide  a  useful  index  of  the  level 
of  invormatlon  processing  or  mental  load  of  a  diver  and  secondly,  that  research 
into  eye  movements  might  aid  us  in  understanding  better  the  effects  of  the 
physical  environment  experienced  by  a  diver.  This  paper  reports  recent  research 
in  air  between  eye  movements  and  performance.  The  findings  are  positive  and  offer 
promise  that  spectral  analysis  of  eye  movement  velocities  could  provide  valid 
early  indication  of  behavioral  dysfunction  in  compressed  gas  and  under  water. 

W/L  Cat.  Code:  3.1,  4.1.7 


Op  Behav.  Codec 
Primary  task 
Physiological 


i.,  2  - 

Single  measures  Experimental  Laboratory  Background 

Eye  and  eyelid 
movement 


Kerr,  B.  Processing  demands  during  mental  operations.  Memory  end  Cognition, 
1973,  1,  401-412. 

Man  possesses  a  central  system  of  limited  capacity.  Theorises  at  first 
described  tills  system  as  a  single  limited  capacity  channel.  Two  current 
theoretical  alternatives  to  single-channel  theory  are  (1)  the  undifferentiated 
capacity  hypothesis  that  man  possesses  a  pool  of  capacity  units  so  that 
interference  occurs  only  if  the  total  number  of  capacity  units  that  mental 
operations  demand  exceed?  the  system  limit  and  (2)  the  hypothesis  that  some, 
but  not  all,  mental  operations  require  space  in  a  limited  capacity  central 
mechanism  and  that  any  operation  that  requires  space  will  interfere  with  any 
other  operation  that  also  demands  space.  Tiiae  on  task  fails  as  a  sensitive 
measure  of  capacity  demands  because  some  task  components  require  time  but 
not  full  processing  capacity.  The  secondary  task  technique  uses  the  inter¬ 
ference  between  o  primary  task  and  a  secondary  task  to  assess  the  extent  to 
which  the  primary  taak  makes  processing  demands  on  the  central  limited 
system.  Processing  nemandj;  have  been  measured  for  five  categories  of  mental 
operation:  (1)  encoding ,  (2)  multiple  input,  (3)  rehearsal,  (4)  tvans format ion, 
and  (5)  responding. 

W/L  Cat,  Code:  2-2,  3.2 

Op.  Behav.  Code:  1. ,  2.,  4. 

Spare  m  capacity  Subsidiary  task  Review  None  Background 

Primary  task  Single  measures  Construct 
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Kikolov,  A.  I.  Mental  work  and  emotions.  Moscow:  Izdatel-stvo  Meditslns, 
1978.  (In  Russian.) 


This  book  outlines  the  possibilities  for  the  occurrence  of  informational 
neuroemorioral  stress  and  mental  fatigue  using  the  example  of  mental  and 
eceotional  activity  of  individuals  performing  high- responsibility  tasks,  such  as 
traffic  controllers.  Available  data  are  used  to  formulate  and  refine  the  concept 
of  neuroemotional  overstress.  Attention  is  given  to  a  discussion  of  the 
characteristics  of  the  development  of  overstress  into  a  neurotic  state  upon  ex¬ 
posure  to  chronic  informational  overload  of  the  brain.  A  number  of  methodological 
approaches  are  described  for  assessing  subjects  engaged  in  emotionally  stressed 
mental  activity.  Problems  of  diagnosis  and  estimation  criteria  for  the  functional 
state  of  the  human  organism  exposed  to  emotional  stress  are  discussed. 

W/L  Cat.  Code:  1.,  2.,  3.,  A. 

Op.  Behav.  Code:  1. ,  2.,  3.,  4. 


Opinion  Multiple 

Spare  m.  capacity 
Primary  task 
Physiological 


Review  None  Background 

Construcc 


Kirchner,  J.H.  and  Laurig,  W.  The  human  operator  in  air  traffic  control 
systems.  Ergonomics,  1973  ^  14,  549-556, 

A  system  analysis  of  the  air  traffic  control  system  with  respect  to  its  purpose 
and  realization  shows  the  role  which  the  human  operator  plays.  The  task  of 
man  in  this  system  is  cne  of  information  processing.  Evaluation  of  the 
operator's  task  is  important  for  selection  of  personnel,  for  job  evaluation, 
and  for  redesigning  tasks  and  jobs.  Evaluation  of  man's  task  can  be  regarded 
from  the  demands  of  the  job  cr  from  their  fulfillment  and  effect  for  man. 

Both  aspects  have  to  be  connected  to  get  objective  results  which  are  ’’alia  for 
man.  Special  research  problems  arise  from  the  influence  of  the  Individual 
abilities  and  from  the  correlation  of  stress  as  a  workload  factor  and  strain 
as  an  effect  of  this  workload  on  man. 


W/L  Cat.  Coda: 
Op.  Behav.  Code: 


2.1.,  3.3 

1.,  2.,  3.,  4. 


Spare  m.  capacity  Task  comp., 

time  assess. 

?rijnai.*y  task  Math,  model 


Construct 


None 


Background 


162 


Klein,  T.  J.  A  workload  simulation  nodal  for  predicting  huaan  performance 
requirements  in  the  pilot-aircraft  environment.  Paper  presented  at  the 
14th  Annual  Meeting  of  the  Huaan  Factors  Society,  Sen  Franciaco,  California, 
October  13-16,  1970. 

A  computerized  workload  simulation  model  for  relating  system  performance 
rsquireaents  to  task  performance  requirements  is  discussed.  The  aouel. 
Continuous  Assessment  of  Task  Time-Stress  (CATTS),  affords  a  quantitative 
assessment  of  instantaneous  operator  time-stress  expected  during  all  segments 
of  a  specified  aircraft  mission.  A  unique  feature  of  the  model  is  its 
capability  for  determining  continuous-control  error-nulling  rate  requirements 
imposed  upon  the  operator  by  aerodynamic  and  cockpit  design  characteristics, 
by  the  equations  of  motion  of  the  aircraft,  and  by  specified  tolerances  in 
the  continuous-control  channels.  The  paper  also  discusses  the  relationship 
of  task  difficulty  to  time-stress  threshold  levels,  and  how  the  model  can  be 
applied  to  aulti-crew  trade  studies  as  well  as  to  human-automatic  functional 
mix  trade-offs. 

V/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  A. 

Sparc  m.  capacity  Task  comp. ,  Construct  None  Flight  simulator 

time  assess. 


Klein,  T.J.  and  Cassidy,  W.B.  Relating  operator  capabilities  to  system 

demands .  Proceedings  of  the  Sixteenth  Annual  Meeting  of  the  Human  Factors 
Society,  Santa  Monica,  California,  Human  Factors  Society,  1972,  32A-33A. 

An  exploratory  study  of  operator  proficiency  in  tasks  analogous  to  piloting 
an  aircraft  is  discussed.  Task  performance  was  measured  while  task  difficulty 
(system  workload  demand)  was  varied  from  easy  through  moderate  and  hard  lavels. 
From  these  measurements,  preliminary  workload  capability  limits  were  derived 
for  single  and  two-axis  control  tasks  and  for  several  combinational  mixes  of 
control  and  procedural  tasks.  The  data  also  provided  a  basis  for  development 
of  mathematical  equations  for  (a)  predicting  work  response  levels  from  known 
system  demands,  (b)  relating  tracking  accuracy  to  system  workload  demands 
and  (c)  combining  tracking  and  procedural  workload  components. 


W/L  Cat.  Code: 

2.1.1,  3.1 

Op.  Behav.  Code: 

1.,  2.,  A. 

Spare  m.  capacity 

Task  comp . , 
time  assess. 

Construct  Laboratory  Flight  simulator 

Primary  task 

Single  measures 

Experimental 
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Klein,  T,  J.  sad  Hall,  A.  A.  An  analysis  of  pilot  performance  requirements 
In  the  A-7E  tram.  Dallas,  Texas:  LTV  Aerospace,  Vought  Systems  Division, 

VSD  Report  Ho.  2-542201  5R-5777,  April,  1975. 

This  report  was  prepared  by  the  Human  Factors  Group  of  Vought  Systems  Division, 
LTV  Aerospace,  to  supplement  the  Preliminary  A-7E  TRAM  Human  Factors  Report. 

The  objective  of  the  effort  was  to  assess  pilot  vorklcad  relative  to  the 
A-7E  TRAM  and  to  compare  it  with  the  workload  requirements  encountered  by  the 
pilot  during  a  typlcel  A-7E  atteck  mission.  To  mast  that  objective,  a  common 
CEP  was  chosen  as  the  bgsis  for  comparison.  Dive  angles  and  air  speeds  are 
different  between  the  day  and  night  attack  modes  due  to  environmental  conditions. 
The  20°  night  dive  angle  was  used  because  It  proved  to  be  the  most  realietlc 
and  comfortable  type  of  attack  during  preliminary  simulation  and  flight  testing. 

W/L  Cat.  Code:  2.1.1,  3.1 

Op.  Behav.  Code:  1. ,  2. ,  4. 

Spare  a.  capacity  Task  comp. ,  Construct  Laboratory  Flight  simulator 

time  assess. 

Primary  task  Single  measures 


Kleinman,  D.  I.  and  Curry,  R.  E.  Some  new  control  theoretic  models  for  human 
operator  display  monitoring.  Proceedings  of  the  1976  IEEE  Conference  on 
Decision  and  Control  Including  the  15th  Symposium  on  Adaptive  Processes, 
Clearwater,  Florida,  December 1-3,  1976,  1023-1029. 

Contro.1  theoretic  techniques  are  applied  to  develop  two  new  models  for  predicting 
human  operator  performance  when  monitoring  an  automatically  controlled  system. 

In  one  case  It  is  assumed  that  the  human  monitors  the  instruments  in  order  to 
rapidly  detect  failures.  The  second  approach  assumes  that  the  instruments  are 
sampled  to  best  reconstruct  the  system  status  information.  The  relation  of 
these  models  to  existing  prediction  schemes,  e.g.  equal  attention  and  the  Sender's 
model  Is  explored.  It  is  concluded  that  a  combination  of  failure  detection  and 
status  estimation  models  offers  the  best  potential  for  h  nan  operator  application. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


2.1.2,  3.3 

1.,  2. 

Inform,  theory 
Math,  model 


Construct 


None 


Background 
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Klotsbucher,  E.  and  Koloff ,  D.  Tha  at tact  of  aantal  Stork  with  and  without 
tlaa  pressure  on  aalactad  phyalological  functions.  Zaitachrift  fur  die 
Sweats  Hygiene  und  Ihra  Cranagablata,  1577,  23,  8-11^  (In  GermanT 

Methods  and  rasults  of  calculation  ta^ts  under  tlaa  pressure  with  telemetric 
recording  of  cardiac  and  respiratory  rates  era  described.  There  were  no 
significant  changes  In  cardiac  rata  and  arrhythmia  or  in  catecholamine  excretion 
in  teats  with  and  without  tlaa  prassura.  Respiratory  arrhythmia  increased 
markedly,  to  a  greater  extant  with  than  without  time  pressure.  In  contrast  to 
the  cardiac  rate  and  arrhythmia  which  apparently  change  only  on  savers  mental 
stress,  respiratory  arrhythmia  appears  to  respond  tc  differences  in  stress  even 
when  the  mental  work  itself  is  not  impaired. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 

Primary  task 
Physiological 


3.1,  4.1.10,  4.1.11,  4.1.12 
1.,  2. ,  4. 

Single  measures  Experimental 
Heart  rate, 
h.r.  var. 

Breathing  anal. 

Body  fluid 
anal. 


Laboratory  Flight  simulator 


Knowles,  W.  B.  Operator  loading  tasko.  Human  Factors.  1963,  5.,  155*161. 

The  purpose  of  this  paper  is:  (1)  To  rev  ^w  the  rationale  of  measuring 
operator  workload  in  terms  of  auxiliary,  or  secondary  task  performance 
scores;  (2)  To  summarise  the  important  characteristics  of  suitable  loading 
tasks;  (3)  To  describe  several  loading  tasks  which  have  been  used  or  which 
are  potentially  useful;  and  (4)  To  suggest  the  development  of  a  set  of 
standardised  tasks  which  would  be  useful  in  obtaining  more  nearly 
comparable  measures  over  a  wide  range  of  primacy  teaks. 


W/L  Cat.  Code:  2.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  Hone  Flight  simulator 

Flight  test 
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Kopala,  C.  J.  The  use  of  color-coded  symbols  in  a  highly  dense  situation  display. 
Proceedings  of  the  23rd  Annual  Meeting  of  the  Human  Factors  Society.  Boston, 
Massachusetts,  October  29-Noveaber  1,  1979,  397-401. 


The  effectiveness  of  redundant  color-coding  for  displays  used  by  highly-loaded 
operators  performing  a  series  of  complex  tasks  has  never  been  clearly  demonstrated. 
Pilot  flight  performance  and  threat  recognition  performance  using  two  coding 
conditions  for  a  threat  display  were  compared  in  a  simulated  mission.  One  coding 
condition  consisted  of  shape-coded  symbols,  the  other  of  symbols  that  were  both 
color-  and  shape-coded.  Redundant  color-coding  was  found  to  significantly  reduce 
both  response  time  and  error  rate. 


W/L  Cat.  Cede:  1.1,  3.1 


Op.  Behav.  Code: 
Opinion 
Primary  task 


1. ,  2. ,  3. ,  4.1 


Rating  scale  Experimental  Flight  simulator 
Single  measures 


Flight  simulator 
Flight  test 


Kornstadt,  H.  J.  and  Pf ennigstorf ,  J.  Evaluation  of  an  integrated  flight  display 
for  the  manurl.  IFR- landing  of  VTOL-aircraft.  Proceedings  of  the  AGARD  Conference 
on  Guidance  and  Control  Displays,  AGAKD-CP-96 ,  10-1  -  10-8.  (AD  739  779) . 

An  integrated  flight-display  for  the  hovering-phase  of  a  VTOL-laading  was 
developed.  The  presentation  of  information  to  the  pilot  has  been  evaluated 
in  simulation  by  three  criteria:  landing  performance,  pilot  rating  and 
measurement  of  the  pilot's  mental  workload.  Adaptation  of  the  display- 
dynamics  and  the  desired  landing-profile  lead  to  higher  level  of  performance 
at  a  decreased  workload. 

W/L  Cat.  Code:  1.1,  2.2.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Spare  m.  capacity  Subsidiary  task  Flight  test 
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Koym,  K.  Q.  Familiarity  «f facta  on  task  difficulty  ratinga.  Brook*  APB,  Taxes: 
USAF  liaaan  Resources  Laboratory,  AFKRL-T8.-77-25,  Juna,  1977. 

This  report  examinee  intarratar  reliability  aatlaataa  for  teak  difficulty  rater* 
having  differing  lavala  of  familiarity  with  rated  tar.ka.  Data  ware  collected 
from  ASS  NCO  supervisors  who  rated  the  difficulty  and  familiarity  of  424  taaka 
in  the  Aircraft  Electrical  Repair  career  ladder  teak  inventory.  The  result* 
showed  that  the  Intarratar  reliability  estimates  (Bfck)  decreased  from  .930  to 
.802  for  six  task  difficulty  rating  scale  conditions  in  which  ratinga  were 
eliminated  due  to  levels  of  familiarity.  This  finding  suggests  that  little 
is  to  be  gained  from  eliminating  task  difficulty  ratings  based  upon  an 
experienced  judge's  level  of  familiarity  with  tasks. 

W/L  Cat.  Code:  1.1 

Op.  Baha"’.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Field  Flight  simulator 

Flight  test 


Kradss,  M.F.  The  psychological  stress  evaluator.  Ellicott  City,  Maryland: 

Howard  County  Police  Department r  Unpublished  manuscript,  1974. 

The  aim  of  this  study  was  to  Investigate  the  validity  of  the  Dektor  Psychological 
Stress  Evaluator  (PSE)  in  lav  enforcement  as  a  stress  measuring  device. 

Supposedly,  involuntary  physiological  response  measured  directly  is  related  to 
the  degree  of  psychological  stress  induced  in  the  subject  by  the  question?  contained 
in  a  properly  constructed  "lie  detection"  examination.  Another  aim  was  to  compare 
the  validity  of  the  Dektor  instrument  with  that  of  a  polygraph  used  in  the  same 
situation.  All  other  components  of  the  "lie  detection"  system  remained  constant, 
leaving  the  instrumentation  as  the  only  variable.  The  hypothesis  tested,  there¬ 
fore,  was  that  the  voice  stress  reactions  indicated  by  Dektor  PSE  would  correlate 
with  the  degree  of  stress  contained  in  answers  to  questions  regarding  a  real 
crime  in  which  the  subject  was  a  suspect.  It  is  concluded  that  the  PSE  ir,  a 
valid  component  worthy  of  Inclusion  in  the  lie  dectlon  application  system,  either 
in  tandem  with  the  polygraph  or  used  as  a  single  measure. 

W/L  Cat.  Code:  4.3 

Op .  Behav .  Code :  2 . ,  3 . 

Physiological  Speech  patt.  Experimental  Field  Background 

anal. 
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Kraft,  C.  L.  and  Eivorth,  C.  1.  Flight  dack  workload  and  night  visual 
approach  parf orunct .  In  AGARD  Measure  cf  aircrew  performance.  Raport 
Mo.  N7C -19786,  December,  1969. 

Research  with  a  night  visual  approach  simulator  has  provided  data  supporting 
a  logical  explanation  for  about  16Z  of  air  transport  accidents.  The  explanation 
la  in  the  form  of  a  two-part  hypothesis:  a  descent  path  that  nulls  out  some 
visual  information  and  a  delay  in  relative  motion  supplement  of  the  sane 
information.  The  missing  topographic  information  allows  incorrect  interpretation 
of  altitude  and  distance.  Most  operational  examples  of  this  class  of  accidents 
include  information  about  crew  distractions,  critical  intrusions  and  workloads. 

In  recent  investigations,  the  flight  deck  workloads  were  altered  by  varying 
the  frequency  of  appearance  of  other  traffic  which  the  pilot  was  instructed  to 
detect  and  report  to  ground  control.  Analysis  of  the  effect  of  workload  on 
performance  revealed  this  to  be  a  significant  factor  only  as  it  interacted 
with  terrain  slope  and  pilot  differences,  but  not  otherwise. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  11,  1.2,  4.2 

Sparc  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 


I 

I 

I 


Krahenbuhl,  G.  S. ,  Marett,  J.  R.,  and  King,  N.  W.  Stress  and  performance  in 
T-37  pilot  training.  Brooks  Air  Force  Base,  Texas:  Air  Force  Human 
Resources  Laboratory,  AFHRL-TR-77-3,  May,  1977.  (AO  A041  734). 

Catecholamine  excretion  was  determined  for  student  pilots  (n  -  8)  during  training 
conditions.  When  viewed  as  the  dependent  variable,  catecholamine  excretion  patterns 
support  the.  conclusion  that  the  Basic  Cockpit  Training  Emergency  Procedures  unit 
was  not  stressful.  The  remaining  lesson  units,  including  Power-on  Stall  and 
Spin- recovery.  First  Solo,  and  Instrument.  Check  lesson  units,  resulted  in  a 
pronounced  stress  response.  When  catecholamine  excretion  data  were  interpreted 
for  psychological  significance,  it  was  concluded  that  the  lesson  unit  which 
included  Power-on  Stalls  and  Spin-recoveries  created  the  highest  arousal,  anxiety, 
and  apprehension.  Student  pilot  observations  support  this  interpretation.  The 
relative  production  of  epinephrine  and  norepinephrine  showed  changes  accompanying 
pilot  training  which  may  be  interpreted  as  demonstrative  of  successful  coping 
behavior. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Physiological 


4.1.12 

1.,  2.,  3.,  4. 

Body  fluid 
anal. 


Experimental  Flight  test 
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Krause.  S.  F.  and  Roscoe,  S.  N.  Raorganlsatien  of  airplane  manual  flipbt 
control  dynamics.  W.  B.  Know lea,  M.  S.  Sailers,  and  F.  A.  Muckier  (Eds.) 
Proceedings  of  the  Sixteenth  Annual  Meeting  of  the  Human  Factors  Society. 

Santa  Monica,  Californio:  Rucan  Factors  Society,  .1972,  117-126. 

Experiments  vara  conducted  in  a  Singer-Link  GAT-2  simulator  to  evaluate  the 
effectiveness  of  a  system  providing  direct  control  over  aircraft  maneuvering 
performance.  Pilots  performed  complex  navigational  tasks  Involving  the  use 
of  a  computer-assisted  area  navigation  system.  Changing  way-point  storage 
capacity  of  the  simulated  navigation  system  induced  variable  task  loading  on 
subjects.  The  experiment  was  replicated  with  and  without  an  adaptive,  digit 
processing,  side  task  to  determine  levels  of  residual  attention  associated 
with  the  control  modifications  and  the  varying  levels  of  workload.  The  flight 
performance  controller  yielded  greater  precision  of  maneuvering  control,  fewer 
procedural  blunders,  and  an  lncreasad  level  of  residual  pilot  attention. 

W/L  Cat.  Code:  2.2.4,  3.1 

Op.  Behsv.  Code:  1.  ,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  meas^cas  Flight  test 


Krebs,  M.J.  and  tfingert,  J.W.  Use  of  the  oculometer  in  pilot  workload 

measurement.  Washington,  D.C.:  National  Aeronautics  and  Space  Administration, 
NASA  CR-144951,  February,  19Vu. 


This  study  investigated  relationships  between  eye  behavior  and  pilot  workload. 

A  Honeywell  Mark  IIA  oculometer  was  used  to  obtain  the  eye  data  In  a  fixed  base 
transport  aircraft  simulation  facility.  The  data  were  analysed  to  determine  those 
parameters  of  eye  behavior  which  ware  related  to  changes  in  level  of  task 
difficulty  of  the  simulated  manual  approach  and  landing  on  inntmments.  A  number 
of  encouraging  trends  and  relationships  between  eye  variables  and  pilot  ratings 
were  found.  A  preliminary  equation  was  written  based  on  the  results  of  a  step¬ 
wise  linear  regression.  High  variability  in  time  spent  on  various  Instruments 
was  related  to  differences  in  scanning  strategy  among  pilots.  A  more  detailed 
analysis  of  the  obtained  data  for  individual  pilots  was  suggested  as  the  next 
step  in  the  process  of  building  a  model  of  visual  workload. 

W/L  Cat.  Code:  1.1,  3.1,  4.1.7,  4.1.8 

Op.  Behav.  Code:  1.,  2.,  4. 


Opinion 
Primary  task 
Physiological 


Rating  scale  Experimental  Flight  simulator  Flight  simulator 
Single  measures  Flight  test 

Eye  movement 
Pupillary  dla. 
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Krebs,  M.  J. ,  Wingert,  J.W.  and  Cunningham,  T.  Exploration  of  an  oculome  ‘■.ei- 
baaad  nodal  of  pilot  workload.  Waahlngton,  D.C.:  National  Aeronautica  and 
Spaca  Administration,  NASA  CR-145153,  March,  1977. 

This  study  Investigated  relationships  between  aye  behavior  and  pilot  workload. 

A  Honeywell  Mark  IZA  oculometer  was  used  to  obtain  the  eye  data  in  a  fixed  base 
transport  aircraft  simulation.  The  data  were  analysed  to  determine  those 
parameters  of  eye  behavior  which  were  related  to  changes  in  level  of  task 
difficulty  of  the  simulated  manual  approach  and  landing  on  instuments.  Trends 
and  relationships  between  eye  variables  and  pilot  ratings  were  found.  High 
variability  in  time  spent  on  various  instruments  was  related  to  differences  in 
scanning  strategy  among  pilots.  Detailed  analysis  of  individual  runs  by 
Individual  pilots  indicated  a  high  degree  of  intra-pilot  variability  In  instrument 
scanning.  No  consistent  workload  related  trends  were  found.  Pupil  diameter 
which  had  demonstrated  a  strong  relationship  to  task  difficulty  was  extensively 
re-examined.  It  was  concluded  that  the  generalized  measure  which  showed  this 
relationship  was  most  likely  not  purely  pupil  diameter  but  a  composite  index 
incorporating  the  influence  of  other  variables  such  as  instrument  scanning. 

W/L  Cat.  Code:  1.1,  3.1,  4.1.7,  4.1.8 

Op .  Behav .  Code :  1 . ,  2 . ,  4 . 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Primary  task  Single  measures  Flight  test 

Physiological  Eye  movement 

Pupillary  dia. 


Kreifeldt,  J.,  Farkir,  L.  and  Rothschild,  ?.  Impl~ cations  of  a  mixture  of 
aircraft  with  and  without  traffic  situation  ilsplays  for  air  traffic 
management .  Proceedings  of  the  12th  Annual  NASA-University  Conference  on 
Manual  Control,  University  of  Illinois,  May,  1976,  179-200.  (NASA  TM  7.-73  170). 

A  mixture  of  aircraft  (A/C)  with  and  without  traffic  situation  displays  (TSD) 
was  simulated  to  ascertain  its  effects  on  distributed  air  traffic  management 
in  t  ie  :rminal  area.  The  three  simulator  A/C  and  four  or  five  computer 
simulated  A/C  were  embedded  in  a  terminal  area  traffic  problem  with  as  much 
realism  as  possible.  All  A/C  were  considered  to  be  STOLcraft.  Analyses  were 
made  of  flight  performance  measures,  verbal  communications  and  subjective 
evaluations  by  the  professional  pilots  and  controllers  who  served  as  subjects. 

The  analyses  favor  the  TSD  equipped  A/C,  and  the  distributed  mode  of  management 
permitted  by  this  cockpit  capability.  However  there  are  indications  that  an 
A/C  without  a  TSD  in  a  TSD  environment  may  require  or  receive  considerably 
more  controller  attention  and  pilot  disfavor  than  when  it  is  in  an  all 
vectored  environment.  This  may  imply  that  TSD  and  nonTSD  A/C  should  be 
segregated  and  controlled  accordingly. 

W/L  Cat.  Code:  1.1,  3.1 

Op.  Pabav.  Code:  3.,  4.2 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Primary  task  Single  measures  Flight  test 
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Krivohlavy,  J.  Physiological  correlates  of  tha  informational  performance. 
Actlvitas  Nervosa  Superior,  1968,  10,  165-171.  (In  Chechoslovakian). 

The  relationship  between  heart  and  respiratory  rate,  regularity  of  pulse, 
depth  of  .inspiration  and  the  amount  of  presented  info:  lation  was  studied 
on  twenty  two  subjects  under  two  different  conditions:  the  amount  of 
presented  information  equalled  either  3/4  or  5/4  of  the  individual  capacity 
(underload  and  overload  conditions).  Mo  simple  correlation  was  found,  but 
the  subjects  with  the  low  heart  rate  and  a  small  error  number  during  under¬ 
threshold  performance  showed  an  increase  of  heart  rate  during  the  overload 
performance, and  subjects  with  higher  heart  rate  and  higher  error  number 
during  underload  performance  had  an  opposite  tendency.  The  pulse  Irregularity 
Increased  with  the  amount  of  information  only  during  mental  reproduction  but 
not  during  verbal  reproduction.  In  conclusion  the  importance  of  the  attitude 
as  a  regulator  of  voluntary  activity  Is  stressed;  physiological  functions 
reflect  the  changes  In  the  level  of  mental  activation,  which  is  only  partially 
determined  by  the  presented  or  processed  information. 

W/L  Cat.  Code:  4.1.10,  4.1.11 

Op.  Behav.  Code:  1.,  2. 

Physiological  Heart  rate  Experimental  Laboratory  Flight  simulator 

h.r.  var. 

Breathing  anal. 


Krivohlavy,  J.  Pulse  rate  and  information  load  during  typing.  Activltas 
Nervosa  Superior,  1968,  10,  172-176.  (In  Czechoslovakian). 

The  conclusion  of  G.  Ganeev,  et  al.  from  1967  was  checked.  He  asserted 
that  the  pulse  rate  can  be  used  as  an  objective  criterion  of  the  degree  of 
tension  of  higher  nervous  centers.  Experiments  of  Ganeev,  et  al.  were 
repeated  but  the  results  obtained  did  not  confirm  this  statement.  The 
significance  of  differences  appears  to  be  problematic.  These  doubts  are 
based  on  results  of  other  experiments  with  increasing  the  input  of  the 
flow  of  information.  Even  if  it  is  not  possible  to  derive  from  the  lack 
of  significance  the  non-existence  of  the  relationship,  the  results  would 
suggest  caution.  Doubtful  is  also  the  a  priori  Identification  'of  the 
degree  of  tension  of  higher  nervous  centers'  with  'the  magnitude  of  the 
required  information  performance'  as  stated  in  the  work  of  Bulgarian  authors. 

U/L  Cat.  Code:  4.1.10 


Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Heart  rate,  Experimental  Field 

h.r.  var. 


Flight  simulator 
Flight  test 
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Krol,  J.  F .  Variations  in  ATC-wo.k  load  as  a  function  of  variations  in 
cockpit  workload.  Ergonomics ,  1971,  1£,  585-590. 

The  relation  between  pilots'  workload  and  radar  controllers'  workload  was 
investigated.  Pilots'  workload  served  as  the  Independent  variable.  It  was 
assumed  that  a  number  of  levels  of  workload  can  be  distinguished  in  a 
standard  airport  traffic  circuit  under  visual  flight  rules.  The  dependent 
variable  (controllers'  workload)  was  measured  by  response  frequency  on  an 
auditory  binary  choice  task.  Results  indicate  a  rise  in  radar  controllers’ 
workload  in  a  predicted  direction  for  a  nuraoer  of  pilots’  workload  levels. 


W/L  Cat,  Code: 

Op.  Behav.  Code: 

Spare  m.  capacity 
Primary  tae1' 


2.2.1,  3.1 
1.,  2.,  3.,  4. 

Subsidiary  task 
Sinple  measures 


Experimental  Flight  test  Flight 

Flight 


Simula  or 
test 


Ilrtanovskl,  V,  J.  and  Nicholson,  A.  N.  Analysis  of  pile  assessment  of 
workload.  Aerospace  Medicine,  1972,  ji3,  993-997. 

In  a  previous  study  on  the  activity  of  the  nervous  system  during  the  let¬ 
down,  approach  and  landing  of  a  transport  aircraft  the  workload  was  assessed 
by  the  pilot.  Correlations  were  established  between  overall  workload  of 
t,r  let-down  and  individual  factors  which  influence  the  workload  pattern 
a  b  tween  the  subjective  assessments  of  workload  and  physiological  change 
in  the  pilot.  In  the  present  paper  assessments  of  workload  ovtr  a  four-year 
period  have  been  examined  tc  determine  the  techniqu  used  by  the  pilot  to 
evaluate  workload  from  the  various  factors  of  the  let-down  and  to  assess 
the  consistency  of  his  technique. 

W/1.  Cat.  Code:  3.1,  4.2 

Op.  Behav,  Code:  ].,  2.,  4. 

Primary  trsk  Mult,  measures  Experimental  Field  Flight  simulator 
Physiological  flight  test 
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Kuhnr,  If.  T. ,  Gavel,  P.  and  Moreland,  J.  A.  Impact  *of  automation  updn  air" 
traffic  control  system  produr.tivity/capaclty  (ARTS-111).  Washington,  D.C.: 
Federal  Aviation  Administration,  FAA-RB-77-39,  November,  1976.  (AD  A038  659). 

This  report  documents  the  results  of  ?  study  to  assess  tue  Impact  of  the  Automated 
Rad*?  Terminal  System  (ARTS  3)  upon  air  traffic  contr  1  system  capacity.  It  is 
based  upon  on-site  measurements  of  air  traffic  activity,  controller  work  pace, 
controller  workload  indicators,  and  staffing  at  the  San  Antonio,  Texas  and  San 
Pranciacc/Oakland,  California  TRACONS.  Measurements  were  taken  of  both  the 
pre-ARTS  3  end  post-ARTS  3  environments  and  comparisons  made  to  determine  the 
direction  and  degree  of  change  attributable  to  ARTS  3.  The  results  Indicate 
that  the  ARTS  3  system  has  reduced  controller  workload  and  Increased  system 
capacity  by  10. 5X.  A  reasonable  estimate  of  the  productivity  increase  is  8.5X. 

W/L  Cat.  Code:  1.1,  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3  ,  4.1 

Opinion  Rating  scale  Experimental  Field  Flight  simulator 

Spare  m.  capacity  Task  comp. ,  Flight  test 

time  assess. 


Kundiev,  I.  I.,  'lavckatikian,  A.  0.,  Tom&shevskaia,  L.  I.,  Derkach,  V.  S.,  and 
Kovaleva,  A.  I,  Stressful  mental  activity  and  the  regulatory  state  In  the 
cardiovascular  system.  Flziologiia  Cheloveka,  1976,  2,  433-440.  (In 
Russian. ) 

In-vivo  and  in-vitro  experiments  were  conducted  on  subjects  to  study  relevant 
regulatory  parameters  of  cardiovascular  functions  during  stressful  mental  activity 
invoicing  such  elements  as  time  pressure,  risk,  and  threat  of  electroshock  penalty. 
The  measurements  were  obtained  by  radiotelemetric  recording  of  the  cardiac  rhythm, 
polycardicgraphy,  and  mechanocardiography ,  along  with  evaluation  of  circadian 
rhythm  for  excretion  of  epinephrine,  norepinephrine,  and  corticosteroid-17. 
Subjective  evaluation  of  stress  was  made  by  a  ranking  method.  It  is  shown  that 
mental  activity  involving  high  stress  is  accompanied  by  changes  in  the  iutra- 
syateiric  coordination  of  the  functions  of  the  cardiovascular  system  and  returning 
of  the  rhythmic  regulation  of  cardiac  activity. 

W/L  Cat.  Code:  1.1,  4.1.3,  4.1.10,  4.1.12 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Laboratory  Flight  simulator 

Physiological  Heart  rate,  Flight  test 

h.r„  var. 

Body  fluid 
anal. 
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Kuroda,  X.,  Fujiwara,  0.,  Okamura,  N. ,  and  Utsuki,  N.  Method  for  determining 
pilot  stress  through  analysis  of  voice  communication.  Aviation,  Space,  and 
Environmental  Medicine,  1976,  47,  528-533. 

Factors  Inherent  in  aircraft  communication  systems  hinder  customary  approaches 
to  voice  analysis  in  the  determination  of  the  degree  of  stress  experienced  by  a 
pilot  during  an  inflight  emergency.  By  means  of  a  sound  spectrogram,  the  mean 
vibration  space  of  a  voice  can  be  analyzed  if  the  space  between  the  vertical 
deflections  of  the  vowel  sounds  is  calculated  in  micrometers.  The  vibration 
space  shift  rate  (VSSR)  is  calculated  by  comparing  the  widest  vibration  space 
of  the  voice  during  the  normal  phase  of  the  same  flight  (standard  vibration  space: 
SVS)  with  that  encountered  during  the  emergency  situation  (2VS) .  The  number  of 


measuring  points  in  each  case  differs  in  regard  to  the  length  of  communication 
during  the  emergency.  The  VSSR  can  be  divided  into  three  phases — normal,  urgent, 
and  emergency — each  with  three  grades  of  0.5  S.D.  apiece. 

W/L  Cat.  Code: 

4.3 

Op.  Behav.  Code 

:  1. ,  2  ,  3. ,  4. 

Physiological 

Speech  patt.  Experimental 

anal. 

Laboratory  Flight  simulator 

Flight  test  Flight  test 

Lane,  D.  M.  Attention  allocation  and  the  relationship  between  primary  and 
secondary  task  difficulty.  A  reply  to  Kantowitz  and  Knight.  Acta 
Psycholgica,  1977,  40L,  493-495. 

Kantowitz  and  Knight  have  argued  that  Kahneman's  attention-allocation  theory 
requires  primary  and  secondary  task  difficulty  to  interact.  It  is  shown  that 
whether  or  not  these  two  variables  interact  depends  upon  (1)  the  shape  of  the 
function  relating  task  difficulty  and  available  capacity  to  performance  and 
(2)  the  difficulty  levels  of  each  task. 


W/L  Cat.  Code: 

Op .  Behav .  Code : 
Spare  m.  capacity 
Primary  task 


2.2.1,  2.2.2 

x. ,  2.  ,  4- 

Subsidlary  task  Construct 
Single  measures 


None 


Background 
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Lane,  N.E.  and  Strelb,  M.I.  Tha  h varan  operator  simulator:  Workload  estimation 
using  a  simulated  secondary  task.  Proceedings  of  the  AGARD  Conference  on 
Methods  to  Assess  Workload.  AGARJ>-CP-?'6,April,  1977,  All-1  -  All-lT! 

This  paper  describes  the  use  of  the  Human  Operator  Simulator  (HOS)  for  identifying 
potential  workload  problems.  HOS  is  applicable  during  the  midrange  of  system 
developme^l,  between  early  analytic  prediction  methods  and  later  simulator 
evaluations.  The  HOS  system  creates  a  software  simulation  of  a  trained  human 
operator,  his  system  hardware /software  and  required  Interfaces.  Previous  HOS 
applications  have  indicated  a  close  correspondence  in  the  behavior  of  HOS  operators 
and  human  operators  on  the  same  tasks.  The  results  of  this  work  demonstrate  the 
applicability  of  HOS  for  workload  evaluation  and  explores  HCS  operator  behavior 
under  varying  conditions  of  task  demand.  Problems  of  definition  and  methodology 
for  current  workload  measures  are  discussed  and  alternatives  Identified  using 
HOS  to  control  task  difficulty  and  task  demand  parameters.  The  implications  of 
HOS  application  for  cost  and  flexibility  improvements  are  examined,  and  further 
developments  of  the  model  for  workload  evaluation  are  proposed. 

W/L  Cat.  Code:  2.1.1,  2.2.1,  2.2.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Task  comp..  Experimental  Laboratory  Flight  simulator 

time  assess . 

Subsidiary  task 

Lane,  N.E.,  Wherry,  R.J.,  Jr.  and  Strelb,  M.  The  human  operator  simulator: 

Estimation  of  workload  reserve  using  a  simulated  secondary  task.  Proceeding^ 
of  the  AGARD  Conference  on  Methods  to  Assess  Workload,  AGARD-CPP-216,  April 
1977,  All-1. 

This  paper  describes  an  extension  of  the  Human  Operator  Simulator  (HOS)  to 
estimate  workload.  The  HOS  is  a  design  technique  which  provide.s  the  relative 
precision  and  accuracy  of  dynamic  simulation  but  which  can  be  applied  early 
enough  in  design  to  allow  for  needed  system  changes.  The  HOS  system  creates  a 
software  analog  of  the  human  operator,  the  hardware  he  will  operate,  and  the 
required  interfaces.  Previous  simulations  have  indicated  a  close  correspondence 
between  HOS  performance  and  that  of  a  human  operator  on  the  same  task  procedures . 
Work  described  here  discusses  the  potential  of  HOS  as  a  workload  assessment 
technique  luring  system  design,,  using  the  concept  of  secondary  tssk  loading  to 
determine  operator  reserve.  By  varying  primary/secondary  task  demands  and  the 
priorities  assigned  to  each  ta3k  level,  statements  about  reserve  time  available 
can  be  used  to  establish  potential  overload  problems  and  to  provide  a  workload 
"figure  of  merit"  for  alternative  crews tation/ task  configurations. 


W/L  Cat.  Code: 

Op .  Behav .  Cede : 

Spare  m.  capacity 


2.1.1,  2.2.1,  2.2 

1.,  2. ,  4. 


Task  comp . , 
time  assess. 


2 

Construct  None 


Flight  simulator 
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8 
I 

ILaurell,  H.  and  Ilspar,  H.  0.  A  validation  of  subsidiary  reaction  time  against 
detection  of  roadside  obstacles  during  prolonged  driving.  Ergonomics,  1978, 
21,  81-88. 

|  Indirect  psychological  or  physiological  measures  of  driving  performance  are  often 

used  without  supporting  evidence  or  even  comment  on  their  validity.  In  this 
validation  the  performance  of  ten  subjects  on  a  subsidiary  reaction  time  (RT) 

1  task  and  a  visual  detection  task  was  correlated.  On  the  RT  task  93  dB  auditory 

*  signals  were  presented  with  an  average  intersignal  interval  of  50s.  On  the 

detection  task,  the  subjects  had  to  brake  as  fast  as  possible  when  they  perceived 
a  40  x  40  cm  obstacle  at  the  side  of  the  road.  Over  the  test  of  three  hours, 

„  in  night  driving  conditions  on  a  closed  5  km  track,  the  correlation  between  group 

averages  was  -0.78  and  the  average  within-subject  correlation  was  -0.47.  From 
these  results  and  a  discussion  of  the  predictive  and  the  construct  validity  of 
the  RT-task,  it  is  concluded  that  subsidiary  RT  may  be  used  as  a  valid  indicator 
'  of  changes  in  efficiency  of  driving  performance. 

W/L  Cat.  Code:  2.2.1,  3.1 

.  Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Field  Flight  simulator 

•* 

Primary  task  Single  measures  Flight  test 


Laurig,  W.  and  Phillip,  U.  Changes  in  the  pulse  frequency  rhythm  in  relation  to 
the  workload.  (Verdnderungen  der  Pulsfrequenzarrhythmie  in  AbhSngigkeit  von 
der  Arbeitsschvere) .  ArbeiiBmedizin  Sozialmedlzln,  Arbeitshyglene,  1970,  j>, 
184-188.  (Royal  Aircraft  Establishment  Library  Translation  1586). 

Starting  with  a  phenomenonological  description  of  the  heart  rate  rhythm,  an 
arrhythmia  condition  has  been  derived  theoretically.  Experimental  results  from 
physical  and  mental  work  have  given  values  for  the  average  behavior  of  the 
arrhythmia  quotient  in  relation  to  the  intensity  of  the  work  of  a  large 
collection  of  male  subjects.  A  regression  calculation  over  the  individual 
results  of  all  the  experiments  shows  a  reduction  in  the  arrhythmia  quotient 
with  the  workload.  A  control  theory  description  is  used  for  the  behavior 
of  the  arrhythmia  on  re  it.  The  significance  of  heart  rate  measurements  in 
medical  practice  is  discussed. 


W/L  Cat.  Code:  4.1.3,  4.1.10 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  ERG  Construct  Laboratory  Flight  simulator 


Heart  rate, 
h.r.  var. 


Experimental 


Flight  test 
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Lauschner,  E.  A.  (Ed.)  Measurement  of  aircrew  performance:  The  flight  deck 
workload  and  its  relation  to  pilot  performance.  AGARD  Aerospace  Medical 
Panel,  AGARD-CP-56,  May,  1969. 


Contents:  Flight-deck  workload  studies  in  civil  transport  aircraft;  Energy 
cost  of  piloting  fixed  and  rotary  wing  army  aircraft;  Psychomotor  performance 
under  thermal  stress-A  critical  appraisal;  Operational  measures  of  pilot 
performance  during  final  approach  to  carrier  landing;  Aircrew  task  loading 
in  the  Boeing  multimission  simulator;  Physiological  assessment  of  pilot 
stress  .during  landing;  Exploratory  study  of  pilot  performance  during  high 
ambient  temperatures  and  humidity. 


W/L  Cat.  Code:  1.,  2.,  3.,  4 
Op.  Behav.  Code:  1. ,  2.,  3.,  4. 


Opinion  Multiple 

Spare  m.  capacity 
Primary  task 
Physiological 


Review  Flight  simulator 

Construct 

Experimental  Flight  tec" 


Flight  simulator 
Flight  test 


Laville,  A..,  Teiger,  C.,  and  Duraffourg,  J.  An  attempt  to  evaluate  workload 
in  a  repetitive  task.  Paper  presented  at  the  annual  conference  of  the 
Ergonomics  Research  Society,  April,  1972. 

The  study  of  performance  is  not  sufficient  to  evaluate  workload,  especially  in 
an  industrial  situation  where  the  organization  of  the  work  does  not  allow  large 
variations  in  quantity  or  quality  of  the  work  done.  The  first  approach  to  an 
evaluation  of  workload  in  this  type  of  task  is  an  analysis  of  the  meefc  <nlsms  used 
by  the  operators.  We  have  attempted  this  analysis,  .In  the  study  of  a  work-station 
on  a  television  assembly  line,  in  conjunction  with  certain  measures  of 
physiological  parameters,  notably  those  related  to  posture*.  The  results  obtained 
show  Important  changes  in  method  of  operation  used  as  a  function  of  certain 
difficulties  in  the  task.  The  modifications  can  be  Interpreted  as  the  bringing 
into  play  of  adaptive  mechanisms  to  a  situation  variables,  where  these  coexist 
requirements  of  speed  and  accuracy  in  execution  of  this  type  of  task,  the 
variation  in  certain  parameters  of  posture  can  be  shown  to  have  a  relationship 
with  the  result**  obtained  from  an  analysis  of  work. 

W/L  Cat.  Code: 

Op.  Behav.  Code: 

Spare  m.  capacity 

Phyaio logical 


'  i 

j 

< 


2.1.1,  4.1.9 
1.,  2. ,  4.1 

Task  comp . ,  Experimental  Field  Flight  simulator 

time  assess. 

Muscle  tension 
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Lawrence,  G.  H.  Brain  waves  and  the  enhancement  of  pilot  performance.  In 

B.  0.  Hartman  and  R.  E.  McKenzie  (Eds.)  Survey  of  methods  to  assess  workload. 
AGARD-AG-246,  August,  1979,  93-102. 

The  use  of  brainwaves  (EEG)  for  the  enhancement  of  the  performance  of  aircraft 
pilots  is  an  idea  which  requires,  for  its  development,  the  integration  of  two 
previously  independent  lines  of  research  endeavor:  human  performance  assessment 
and  central  nervous  system  neurophysiology.  A  human  performance  research  paradigm 
specifically  relevant  to  the  study  of  pilot  performance,  in  the  context  of  which 
the  use  of  brain  waves  may  feasibly  be  studied,  will  be  discussed  later.  Attention 
is  now  directed  to  the  state  of  the  art  of  brain  wave  research  and  brain-behavior 
relationships,  specifically  those  aspects  which  are  considered  to  be  feasibly 
and  usefully  applicable  for  potential  use  in  simulated  aircraft  crew  stations 
or  eventually  in  a  real-world  environment. 

W/L  Cat.  Code:  4.1.5,  4.1.6 

Op.  Behav.  Code:  1.,  2. 

Physiological  EEG  Review  Laboratory  Flight  simulator 

ECP 


Lebacqz,  J.  V.  and  Aiken,  E.  W.  A  flight  investigation  of  control,  display, 
and  guidance  requirements  for  decelerating  descending  VTOL  instrument 
transitions  using  the  X-22A  variable  stability  aircraft.  Volume  I.  Buffalo, 
New  York:  Calspan  Corporation,  AK-5336-F-1,  September,  1975. 

A  flight  research  program  using  the  variable  stable  ty  X-22A  aircraft  was  under¬ 
taken  to  investigate  control,  display,  and  guidance  requirements  for  VTOL 
instrument  transitions.  The  primary  purpose  of  the  experiment  was  to  provide 
meaningful  data  related  to  the  interaction  of  aircraft  control  system  and 
displayed  information  characteristics  on  pilot  rating  and  performance.  Primary 
results  of  the  program  Include  the  demonstration  of  an  inverse  relationship 
between  control  complexity  and  display  sophistication,  as  was  hypothesized  in 
the  experiment  design,  and  the  definition  of  acceptable  and  satisfactory  control/ 
display  combinations.  Analysis  of  the  results  in  terms  of  simple  pilot-in-the- 
loop  considerations  and  measured  performance  and  workload  provide  Initial 
guidelines  for  the  design  of  future  VTOL  control-display  characteristics. 

W/L  Cat.  Code:  1.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  test  Flight  test 

Primary  task  Single  measures  Flight  simulator 
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Lap 1st,  J -  Factors  determining  work- load.  Ergonomics ,  1978,  21,  143-149. 

In  this  short  introduction  to  the  topic  o f  the  symposium,  some  analytical 
elements  are  suggested  for  the  concept  of  work-load,  the  large  variety 
of  work-load  categories  is  recalled,  and  mention  is  made  of  some  factors 
determining  work- load,  which  will  be  elaborated  on  in  the  papers  presented 
by  other  authors. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Multiple  Construct  hone  Flight  simulator 

Spare  m.  capacity  Flight  test 

Primary  task 
Physiological 


Leplat,  J.  and  Pallhous,  J.  The  analysis  and  evaluation  of  mental  work.  In 
W=  T.  Singleton,  J.  G.  Fox,  and  D.  Whitfield  (Eds.)  Measurement  of  man  at 
work.  London:  Taylor  and  Francis,  1973,  51-56. 

Mental  work,  which  is  essentially  non-obsewable,  presents  serious  difficulties 
to  the  analyst  who  wishes  to  evaluate  it.  This  kind  of  work  is  found  Increasingly 
in  our  society,  even  where  the  task  requires  a  relatively  low  level  of  skill, 
and  interest  in  its  study  is  Increasing.  In  this  paper  we  consider  various 
analytical  procedures  of  analysis  and  evaluation  and  assess  the  results  obtained. 

The  analysis  provides  an  opportunity  to  compare  the  methods  of  the  applied  psycholo¬ 
gist  and  the  work  physiologist  and  to  expose  the  differences  involved.  Tie 
distinction  which  we  shall  propose  in  terms  of  load  or  intellectual  me chan,  sms 
appears  to  be  quite  fundamental;  it  covers  many  totally  different  scientific 
attitudes;  it  leads  to  distinct  types  of  techniques,  even  if  in  practice  they 
may  be  utilised  successively  at  two  different  periods  of  an  investigation. 

Such  an  analysis  should  contribute  to  the  dialogue  with  our  physiologist  colleagues. 

W/L  Cat.  Code:  2.2,  4.1 

Op.  Behav.  Code:  1. ,  2. ,  3. ,  4. 

Spare  m.  capacity  Subsidiary  task  Review  None  Background 

Physiological  EEC 

EMC, 
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Levine,  J.  M. ,  Ogden,  G.  D.  end  Eisner,  E.  J.  Measurement  of  workload  by 

secondary  tasks:  A  review  and  annotated  bibliography.  Washington,  D.C.:  • 
Advanced  Research  Resources  Organization,  Contract  No.  NAS2-9637,  January,  1978. 

An  annotated  bibliography  of  the  post  -  1965  behavioral  science  literature 
concerned  with  the  use  of  secondary  tasks  in  the  measurenu.  _t  of  operator 
workload  was  prepared,  and  an  organization  of  this  . .terature  was  accomplished. 

The  bibliography  contains  146  empirical  references  and  17  review  or  theoretical 
papers.  The  references  were  categorized  according  to  the  type  of  p*traary  and 
secondary  tasks  used.  Methodological  and  theoretical  issues  in  the  use  of  c 
secondary  task  technique  are  discussed  and  suggestions  for  further  research 
efforts  are  made. 

W/L  Cat.  Code:  2. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  None  Flight  simulator 

Flight  test 


Levison,  W.  H.  A  model  for  task  interference.  Proceedings  of  the  6th  Annual 
NASA-Univer8ity  Conference  on  Manual  Control,  Wrif,nt-Patterson  AFB,  Ohio, 

April  7-9,  1970,  585-616. 

A  model  is  presented  for  interference  ai».ong  multiple  continuous  manual  control 
tasks.  This  model  is  based  upon  the  assumption  that  multiple  tanks  are  performed 
In  parallel  and  that  the  human  must  share  a  fixed  amount  of  central-processing 
capacity  among  the  tasks.  The  equivalent  observation  noise  associated  with  a 
subtask  is  shown  to  be  related  to  the  fraction  of  the  controller’s  capacity 
allocated  to  that  task.  The  model  is  able  to  predict  with  great  accuracy  the 
total  performance  scores  measured  in  a  set  of  multivariable  tracking  experiments. 
The  model  structure  also  accounts  for  the  effects  of  multivariable  tracking  on 
the  controller's  describing  function  and  remnant. 

W/L  Cat.  Code:  2.2.2,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  Laboratory  Flight  simulator 
Primary  task  Math,  model  Experimental  Flight  test 
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Levlaon,  W.H.  A  model  for  mental  workload  In  tasks  requiring  contiguous 
information  processing.  In  N.  Moray  (Bd.)  Mental  workload:  its  theory 
and  maagurcriant.  New  York:  Plenum  Press,  1979,  189-218. 

This  paper  provides  a  unified  treatment  of  theory,  validation,  and  application 
of  the  model  for  workload  and  attention.  The  section  on  theoretical  development 
presents  the  basic  assumptions  underlying  the  proposed  workload  model,  shews 
the  equivalence  of  time-sharing  and  capacity-charing  notions  of  attention, 
presents  the  basic  model  of  workload,  and  reviews  a  human  operator  model  that 
allows  one  to  predict  the  relationship  between  performance  and  workload.  The 
reader  is  then  directed  tc  the  literature  for  results  that  validate  the  basic 
human  operator  model  as  well  as  the  specific  model  for  mental  workload,  and 
some  pilot-opinion  results  are  cited  to  support  the  argument  that  response 
randomness  can  be  related  to  workload  and  attentlonal  demand.  The  third  major 
section  of  the  paper  discusses  predictive  and  diagnostic  applications  of  the 
workload  model.  Finally,  some  thoughts  are  offered  relating  the  concepts  and 
techniques  discussed  in  this  paper  to  the  goals  of  the  workload  symposium  to 
which  this  paper  is  submitted. 

W/L  Cat.  Code:  3.3 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Math,  model  Review  Laboratory  Flight  simulator 

Construct 


Liebermao,  P.  and  Michaels,  S.  B.  Some  aspects  of  fundamental  frequency  and 
envelope  amplitude  as  related  to  the  emotional  content  of  speech.  Journal  of 
the  Acoustical  Society  of  America,  1962,  34,  922-927. 

Pitch  pulses  were  derived  from  the  utterances  of  three  male  speakers  who  each 
read  eight  neutral  test  sentences  in  certain  "emotional:  inodes,  i.e.,  as  a 
question,  an  objective  statement,  a  fearful  utterance,  r  happy  utterance,  etc. 
Tapes  were  recorded  and  presented  to  separate  groups  of  naive  listeners  who 
categorized  the  emotional  modes  in  forced  judgment  tests.  Results  of  the  tests  . 
show  that  with  unprocessed  speech,  the  listeners  were  able  to  correctly  identify 
the  emotional  content  85%  of  the  time.  When  only  pitch  information  was  presented, 
correct  identification  was  made  44%  of  the  time.  When  amplitude  information  was 
added  to  the  pitch  information,  the  identification  ros.^  to  47%.  Smoothing  the 
pitch  information  with  a  40-osec  time  constant  reduced  the  identifications  to 
38%,  while  100-maec  smoothing  reduced  the  identification  to  25%.  A  120-cps 
monotone  with  amplitude  information  derived  from  the  original  speech  envelope 
amplitude  resulted  in  14%  identifications. 


W/L  Cat.  Code: 

4.3 

Op.  Beahv.  Code: 

1.,  2.,  3. 

Physiological 

Speech  patt. 
anal. 

Experimental  Laboratory 

Background 
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Lindquist,  0.  H.  Design  Implications  of  a  better  view  of  the  multichannel 
capacity  of  a  pilot.  Proceedings  of  the  AGARD  Conference  on  Guidance  and 
Control  Displays,  AGARD-CP-96,  5-1  -  5-6,  February,  1972~.  (AD  739  779). 

A  major  result  of  a  recently  completed  study  ha  been  the  prediction  and 
measurement  of  multichannel  pilot  performance,  ,'ch  significantly  increaseu 
his  information-handling  capability  beyond  that  predicted  by  today's  techniques. 
Current  techniques  of  predicting  man/machine  Interactions  were  shown  to  be  in 
error  by  an  order  of  magnitude  in  some  measurements  related  to  human  channel 
capacity.  Thi  results  of  this  experimental  work  are  presented  and  system  design 
implications  for  pilot  capability  and  limitations  are  discussed. 

W/L  Cat.  Code:  2.1. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp. ,  Construct  Flight  simulator  Flight  simulator 

time  assess. 

Experimental 


Linn,  V.  C.,  Jr.  The  parotid  fluid  technique  for  the  evaluation  of  mental  stress 
in  a  production  situation.  Texarkana,  Texas:  US  Army  Logistics  Management 
Center,  USAMC  Intern  Training  Center,  USAMC-ITC  Report  No.  2-72-05,  July,  1972. 
(AD  761  025). 

This  paper  presents  a  method  for  the  evaluation  of  mental  stress  in  production 
situations  where  mental  fatigue  is  considered  a  significant  problem.  The 
level  of  mental  stress  which  the  operator  experiences  is  reflected  in  the 
concentration  of  17-hydroxycortlcosteroid  in  his  parotid  fluid.  Included  is 
a  discussion  of  the  theory  behind  the  technique  and  Its  procedural  application. 

The  use  of  the  technique  to  reduce  mental  stress  and  the  effects  of  mental 
fatigue  in  a  production  facility  is  also  discussed. 

W/L  Cat.  Cone:  4.1.12 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Body  fluid  Construct  Field  Flight  slmulrtor 

anal. 


Experimental 


Flight  test 
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Linton,  P.  M.  VFA-V/STOL  crw  loading  analysis.  Warminster,  Pennsylvania: 

U.S.  Naval  Air  Development  Center,  NADC-75209-40,  May,  1975. 

The  purpose  of  this  study  was  to  determine  whether  a  single  crew  member  could 
effectively  execute  proposed  VFA-V/STOL  missions  or  whether  a  two  man  crew 
would  be  necessary.  The  question  was  addressed  primarily  through  the  deter¬ 
mination  of  workload  Imposed  upon  a  single  operator  during  selected  missions. 
Scenarios  were  generated  for  a  deck  launched  intercept  fighter  mission  and  a 
close  air  support  attack  mission.  Functional  flow  block  diagrams  were  deter¬ 
mined  and  detailed  task  analyses  completed  for  the  high  workload  phases  of 
these  missions.  A  representative  VFA-V/STOL  cockpit  was  designed  and 
fabricated  to  assist  in  the  calculation  and  later  validation  of  crew  loading. 

The  data  were  analyzed  by  the  statistical  workload  assessment  model  (SWAM)  of 

the  computer-aided  function  allocation  evaluation  system  (CAFES)  at  d  the 
results  suggest  that  a  one  man  crew  should  be  sufficient  for  the  VFA-V/STOL 
aircraft. 

W/L  Cat.  Code:  2.1. 

Op .  Behav .  Code :  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp. ,  Construct  Flight  simulator  Flight  simulator 

time  assess. 

Inform,  theory  Experimental 


Linton,  P.  M. ,  Jahns,  D.  W.  and  Chatelier,  P.  R.  Operator  workload  assessment 
model:  An  evaluation  of  a  VF/VA-V/STOL  system.  Proceedings  of  the  AGARD 
Conference  on  Methods  to  Assess  Workload,  AGARD-CPP-216.  April,  1977, 

A12-1  -  A12-11. 

By  systematically  describing  the  steps  undertaken  to  estimate  the  workload  in 
a  conceptual  fighter/attack  V/STOL  aircraft,  meeting  Navy  mission  requirements, 
this  paper  shovs  that  while  a  single  crewmember  can  probably  manage  the  V/STOL 
in  its  primary  mission  phases,  additional  and  refined  workload  assessment 
evaluations  will  be  required  to  conclusively  settle  the  issue  for  all  aspects 
of  deployment.  In  addition,  it  is  suggested  that  an  integrative  concept  of 
operator  workload  be  developed  to  more  accurately  reflect  the  psychological/ 
physiological  demands  made  of  the  operator  in  the  course  of  system  operations. 

W/L  Cat.  Code:  2.1. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp..  Construct  Flight  simulator  Flight  simulator 

time  assess. 

Inform,  theory  Experimental 
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Liaper,  H.  Q. ,  Laurell,  H.  mid  Stening,  G.  Effects  of  experience  of  the  driver 
on  heart-rate,  respiration-rate,  and  subsidiary  reaction  time  in  a  three  hours 
continuous  driving  task.  Ergonomics ,  1973,  16,  501-506. 

From  accident  statistics  a  difference  was  hypothesized  between  experienced  and 
inexperienced  drivers  in  vulnerability  to  continuous  driving.  This  difference 
was  used  as  a  basis  for  a  comparison  of  changes  in  autonomic  measures  and  reaction 
time  over  driving  time.  The  result  shoved  significant  effects  of  experience  on 
both  types  of  measures.  Heart-rate  pointed  to  experienced  and  reaction  time 
pointed  to  Inexperienced  drivers  as  being  the  most  vulnerable  to  continuous 
driving.  This  contradiction  was  solved  with  reference  to  statistical  data  and 
validation  cf  the  reaction  time  task.  Thus  in  this  study  reaction  time  was 
preferred  to  the  autonomic  measures. 

W/L  Cat.  Code:  2.2.1,  4.1.10,  4.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Field  Flight  simulator 

Physiological  Heart  rate  Flight  test 

h.r.  var. 

Breathing  anal. 


Logan,  G.  D.  On  the  use  of  a  concurrent  memory  load  to  measure  attention 
and  automaticity .  Journal  of  Experimental  Psychology:  Human  Perception 
and  Performance,  1979,  5,  139-207. 


The  concurrent-memory-load  technique  identifies  attention  demands  with  inter¬ 
actions  between  reaction-time-task  parameters  and  the  size  of  the  load  on  memory. 
Three  experiments  are  reported  in  which  a  multiple-choice,  reaction  time  task 
involving  two,  four,  and  eight  stimulus-response  (S-R)  alternatives  was  performed 
alone  and  in  the  retention  interval  of  a  short-term-memory  task  involving  ordered 
recall  of  eight  digits.  The  experiments  have  validated  the  concurrent-memory- 
load  technique  by  showing  that  interaction,  additivity,  and  a  transition  from 
interaction  tc  additivity  can  all  occur  in  real  data.  The  tentative  conclusion 
that  practice  with  consistent  mapping  seems  to  be  a  necessary  and  sufficient 
condition  for  producing  the  transition  relates  the  technique  to  other  theory 
and  data  on  attention  and  automaticity  and  attests  further  to  its  validity. 


W/L  Cat.  Code: 

2.2.1,  3.1 

Op.  Behav.  Code: 

1.,  2.,  3.,  4.1 

Spate  m.  capacity 

Subsidiary  task  Experimental 

Primary  task 

Single  measures 

Laboratory 


Background 
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Lorens,  S.  A.,  Jr.  and  Darrow,  C.  W.  Eye  movements,  EEG,  GSR,  and  SKG  during 
mental  multiplication.  Electroencephelography  arid  Clinical  Neurophysiology . 

1976,  14,  739-746. 

Physiological  measures  were  taken  for  ten  subjects  before  and  during  mental 
multiplication  tasks.  Each  of  the  ten  subjects  showed  a  significant  Increase  in 
eye  movement  rate  (EMR)  during  mental  multiplication.  These  data  suggest  that 
rapid  ocular  movement  is  a  consistent  concomitant  of  mental  multiplication  under 
the  conditions  described.  The  increase  in  EMR  during  mental  multiplication  was 
not  related  to  changes  in  heart  rate,  conductance  level  (CL),  percent  time  occipital 
alpha,  or  to  the  presence  of  a  palmar  galvanic  skin  response  (PGR)  following 
presentation  of  a  problem,  although  a  tendency  was  observed  for  those  individuals 
with  high  CL's  to  have  both  PGR's  and  high  EMR's.  Records  of  the  six  subjects 
scored  for  per  cent  time  occipital  alpha  each  showed  a  significant  decrease  in 
occipital  alpha  acitivity  during  mental  multiplication  attributable  primarily  to 
"blocking".  No  unique  EEG  wave  forms  were  identified. 

W/L  Cat.  Code:  4.1.2,  4.1.5,  4.1.7,  4.1.10 

Op.  Behav.  Code:  1.1,  2.,  3. 

Physiological  GSR  Experimental  Laboratory  Flight  simulator 

EEG 

Eye  movement 
Heart  rate, 
h-r.  var. 


Lovesey,  E.  J.  In-flight  recording  of  helicopter  pilot  activity.  Proceedings 
of  AGARP  Conference  on  Studies  on  Pilot  Workload,  AGARD-CPP-217,  April,  1977, 
B3-1  -  B3-10. 

Head  and  hand  activity  patterns  have  been  established  for  UK  Army  and  Air  Force 
helicopter  pilots  under  a  variety  of  operational  flight  conditions  using  a  cine 
filming  technique.  A  fully  portable  cine  camera  fitted  with  &  "fish  eye"  or 
wide  angle  lens  has  been  used  to  record  pilots'  head  and  hand  movements  in  6 
different  helicopters  and  1  fixed  wing  aircraft  types  during  rap-of-the-earth, 
low  level  and  other  flight  phases.  Apart  from  highlighting  problem  areas  in  the 
cockpit,  the  film  records  show  that  activity  patterns  depend  more  upon  the  flight 
profile  than  upon  the  helicopter  type  or  the  individual  pilot.  Subsequent  film 
analysis  has  shown  that  the  pilot  work-load  tends  to  increase  with  decreasing 
height  above  the  ground.  During  nap-of-the-earth  tactical  flying,  a  pilot  may 
spend  over  a  third  of  the  time  looking  inside  the  cockpit  at  maps,  instruments 
and  radios.  This  is  precisely  the  time  when  he  needs  to  spend  the  maximum  time 
looking  outside  to  detect  and  evade  potential  hazards  such  as  wires,  trees,  enemy 
positions  etc.  Reasons  for  the  apparently  paradoxical  behavior  and  the  effect 
upon  pilot  work-load  are  discussed. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  4.2 

Primary  task  Single  measure  Experimental  Flight  test  Flight  simulator 
Physiological  Eye  movement  Flight  test 
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Luczsek,  H.  The  use  of  simulators  for  testing  individual 
Ergonomics ,  1971,  1A,  651-660. 

The  operator,  who  determines  the  functional  relationship 

strain,  is  interpreted  as  the  unit  of  individual  mental  working  capacity.'  & 
theorv  of  mental  stress  built  up  with  concepts  from  formal  logic,  syattps  theory, 
and  information  theory  is  presented.  Three  simulators  of  mental  street',.  •  'v" 
constructed  from  the  theoretical  concept,  are  introduced,  and  attentlio#' given 
to  a  measurement  of  strain  with  cardiac  parameters.  Several  concepts 
evaluation  of  individual  mental  working  capacity  are  considered. 

'.  ■  ■  ■  ‘4.  :w. 

3.3  V'  >'  -v 

1.,  2.,  4.  1 

Math,  model  Construct  Nona  Background 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Primary  task 


mental  working  rapacity. 


•  .  ..  tJy  ■ 

1 


between  stress 


Luctak,  S.  and  lauiig,  W.  An  analysis  of  heart  rate  variability.  Krr.Htos»ICW«- • 
1373,  16,  95-97.  ;/•  : / 

/  ,*  v:  *  ■* . . '  -> 

?rocc&dtn>;  from  z  formal  definition  of  heart  rate  variability,  some  jfcathematic**:' 
and  statistical  techniques  from  sampling  statistics  and  time  series  Analysis  for 
tue  analytical  evaluation  of  heart  rate  variability  for  ergonomics  are 

presented  and  compared.  The  concept  of  sampling  statistics  gives  a  measure  Of 
heart  rate  variability,  arrived  at  by  combining  two  measures,  which  were  t‘ftosen 
according  to  a  definite  criterion.  The  applicability  of  this  measure  la  discussed; 
especially  with  respect  to  serial  correlation  influences  when  using  'Statistical' 
tests.  The  two  main  methods  of  npectral  analyois-the  calculation  at  thp  ..  ■ w;  (i 
transformed  autocovariance  function  and  of  harmonic  analysis-are  proven T*he 
influences  of  into isolations ,  algorithms  and  physiological  effects  ftste  discussed, 

A  possible  measure  ai  heart  rate  variability,  calculated  by  spectral.  estinateo, 
is  proposed  and  some  results  are  given.  ,, 

W/L  Cat.  Code:  4.1.10  .  , 

Op.  Lehav.  Code:  1.,  2.,  4.  t  >“ 

Physiological  Heart  rate.  Construct  Laboratory  Flight  gimtlptor 

h.r.  var. 

FI  ight  tMt 


Experimental 
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Luczak,  H.  and  Rohmert,  W.  Adaptation  reactions  of  workers  in  ergonomic 

field  studies  of  information  processing  work  potentials,  durepear:  Journal 
of  Applied  Physiology,  1976,  35,  33-47.  (In  German.) 

Adaptation  processes  in  the  performance  of  information  processing  tasks  were 
measured  in  19  subjects  in  terms  of  performance  parameters  -  cycle  times,  varid.iee 
of  cycle  times,  informational  content  of  time  and  errors  -  and  in  terms  of. 
phyoiolcfticfil  strain  parameters  -  electromyograms  of  ousculus  (tensor  dlgitorum 
and  musculus  rhoirbc.ideua,  horizontal  and  vertical  electrcoculogram,  heart  rate 
and  heart  rate  variability  -  end  are  described  according  to  type  and  frequency. 
Simultaneous  and  successive  reactions  of  all  measured  quantities  over  the  course 
of  the  work  shift  and  three  successive  days  are  described.  They  are  classified 
as  being  due  to  either  training  or  emotional  habituation  and  are  discussed  in  terns 
of  an  experimenter-experimental  situation  model. 

W/t  Cat.  Code:  2.1.2,  3.1,  4.1.4,  4.1.7,  4.1.9,  4.1.10 

Op.  Benav.  Code:  l.v  2.,  3.,  4. 

Spare  ii).  capacity  Multiple  Experimental  Laboratory  Flight  simulator 

Primary  task 

Physiological 


Pacific ,  M.  Mental  lead,  fatigue,  and  recovering.  Psycho logie,  19  1,  6, 

72-79.  (In  Czechoslovakian). 

This  article  is  concerned  with  the  influence  of  civilization  processes  on  man, 
especially  with  regard  to  the  eensation  of  fa  igue.  It  ib  basai  on  the  fact 
that  man  has  learned  to  change  the  material  world  f nr  more  quickly  than  to 
adopt  himself  to  3uch  changes.  The  problem  of  mantel  load  and  fatigue  are 
at  present  at  the  center  of  attention  in  scientific  research.  The  author 
deals  with  the  causes  of  sencation  of  fatigue  and  characterizes  the  development 
of  artificial  recovering  methods. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op ,  Behav .  Coda :  1.,  2.,  o . ,  4, 

Opinion  Multiple  Construct  None  Background 

Spare  m.  capacity 
Primary  task 
Physiological 
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Mad*ro,  R.  r,  ,  Sexton,  G.  A.,  Gunning,  D. ,  and  Moss,  R,  Total  aircrew  workload 
study  for  the  AMST,  Volume  I,  Results.  Wright-Patterson  Air  Force  Rase, 

Ohio:  Flight  Dynamics  Laboratory,  Final  Technical  Report,  AFFDL-TR-79-3080, 
Vol.  I,  February,  1979. 

There  is  a  growing  realisation  within  the  USAF  that  state  of  the  art  crew  systems 
may  allow  cost  affective  reductions  in  crew  complements.  The  present  study 
addresses  the  minimum  crew  complement  required  and  conceptually,  the  crew  systems 
required  to  support  the  minim-m  crew  of  an  Advanced  Medium  STOL  Transport  (AMST) 
in  the  accomplishment  of  the  tactical  transport  mission.  The  study  involved  the 
simulation  of  a  total  tactical  airlift  mission  which  was  flown  by  operational 
(C.-130)  tactical  airlift  aircrews  to  further  refine  crew  complement  and  crew 
87 item  concepts  established  in  earlier  mockup  studies.  The  results  of  this  study 
indicate  that  two  pilots,  a  loadmaster  and  a  crew  chief  type  additional  crew 
member  can  fly  the  total  AMST  mlssioti  if  provided  with  adequate  state  of  the  art 
ccew  system  capabilities. 


W/L  Cat.  Cod'*.* 
Op.  Behav.  Cede: 


1.,  2.2.3,  3.1 

1..  2.,  3.,  4. 


Opinion  Rating  scale 

Spare  w.  capacity  Questionnaire 
Primary  task  Time  estimation 

Single  measures 


Experimental  Flight  simulator  Flight  simulator 

Flight  test 


Mavkeiw1.cz,  L.,  Koradecka,  T). ,  aud  Konarskc,  M.  Retention  of  selected  physiological 
indicators  in  piicie  in  the  course  of  agricultural  flights.  Washington,  D.C.: 
National  Aeronautics  and  Sp  e  Administration,  Technical  Translation  1T-F- 
17441,  August,  1977. 

Stress  on  the  organism  of  pilots  maneuvering  fixed-wing  or  rotary-wing  aircraft 
in  crop-dusting  and  sowing  operations,  with  abrupt  changes  in  terrain  and  sharp 
turns  required,  is  studied  on  the  basis  of  telemetered  heart  rate,  tremorgrams, 
judications  of  muscle  fatigue  ^particularly,  flexor  muscles  of  the  fingers),  and 
response  to  vibrations.  Comparisons  are  made  of  data  for  low-level  flight  over 
even  terrain  and  nap-of-the-earth  flight  over  hilly  terrain.  Responses  in  fixed- 
wing  flight  and  helicopter  flight  are  also  contrasted.  Criteria  are  proposed 
for  optimization  of  piloting  conditions  in  this  type  of  service. 


W/L  Cat.  Code: 


1.2,  4.1.3,  4.1.9,  4.1.10 


Op .  Behav .  Code :  1 . ,  2 . ,  4 . 


Opinion 

Physiological 


Interviews 

EKG 

Muscle  tension, 
tremor 
Heart  rate, 
h.r.  var. 


Experimental  Flight  test 


Flight  simulator 
Flight  test 
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Mashhour,  H.  The  effect  of  motion  on  atcention  in  man-machine  sy a terns. 

Stockholm.,  Sweden:  University  of  Stockholm,  The  Psychological 

Laboratories,  April,  1969.  (AD  862  320). 

Attention,  particularly  visual  attention,  Is  defined  and  treated  in  terms  of 
information  ,  roctsslng  concepts  through  a  consideration  of  the  "single-channel" 
hypothesis  which  holds  that  the  central  information  processing  mechanlsr  treats 
messages  (signals)  one  at  a  time.  (1)  It  is  pointed  out  that  the  selection  of 
a  message  In  the  visual  system  is  most  likely  to  be  based  on  fuctors  other 
than  the  statistical  nature  of  the  source  (the  number  of  alternative  messages, 
as  defined  in  information  theory) .  Among  these  factors  are  those  which 
activate  the  "orientation  reactions".  (2)  The  effect  of  the  motion  of  a  moving 
man-machitie  system  on  the  human  operator’s  attention  is  studied  on  the  basis 
of  a  model  where  the  operator  is  considered  as  a  servo-component.  It  is  shown, 
among  other  things,  that  by  increasing  the  velocity  of  locomotion  of  such  systems 
(a)  the  sensitivity  of  the  visual  system  decreases,  (b)  human  performance  for 
error  detection  and  error  correction  deteriorates  and  (c)  the  perceptual  and 
motor  overloads  increase.  The  relevance  of  these  relationships  in  the  design 
of  man-machine  systems  and  in  the  analysis  of  accidents  is  emphasized.  And 
finally,  (3)  supporting  data  concerning  engine  drivers'  shifts  of  attention 
are  given  and  commented  on. 

W/L  Cat.  Code:  2.1.1,  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  None  Flight  simulator 
Primary  task  Single  measures  Flight  test 


McCauley,  M.  E.,  Kennedy,  R.  S.,  and  Bittner,  A.  C.,  Jr.  Development  of  performance 
evaluation  tests  for  environments1  research  (PETER):  time  estimation  test. 
Proceedings  of  the  23rd  Annual  Mee  (ng  of  the  Human  Factors  Society,  Boston, 
Massachusetts,  October  29-November  1,  1979,  513-517. 

A  time  estimation  task  was  considered  for  Inclusion  in  the  Performance  Evaluation 
Tests  for  Environmental  Research  (PETER)  battery.  As  part  of  this  consideration 
the  effects  of  repeated  testing  on  the  reliability  of  time  judgments,  using  the 
method  of  production,  was  studied.  Forty  trials  per  day  were  administered 
individually  to  each  of  19  subjects  for  15  consecutive  weekdays.  Descriptive 
statistics  are  reported  and  the  need  for  knowledge  about  the  reliability  coefficient 
over  repeated  test  administrations  in  the  context  of  performance  testing  in 
exotic  environments  is  discussed. 

W/L  Cat.  Code:  2.2.3,  3.1 

Op.  Behav.  Code:  1.,  2.,  4.1 

Spare  m<  capacity  Time  estimation  Experimental  Laboratory  Background 

Primary  task  Single  measures 
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McDonald,  L.  B.  and  Ellis,  H.  C.  Driver  work  load  for  various  turn  ladil  and 
speeds.  In  Priver  performance  studies:  Transportation  Research  record  530. 
Washington,  D.C.:  Transportation  Research  Board,  TRR  530,  1975,  18-30. 

The  need  exists  for  a  method  by  which  a  highway  designer  can  determine,  during 
the  design  stage,  whether  a  highway  design  will  demand  so  much  of  a  driver’s 
attention  that  there  Is  Insufficient  time  to  look  for  and  avoid  accidents. 

One  aspect  of  attentional  demand  is  tracking  the  lane  In  curves  and  tangent 
sections.  A  study  was  done  to  determine  (by  use  <  f  a  secondary  task)  what 
percentage  of  a  driver’s  attention  Is  required  to  track  a  lane  while  various 
curves  are  negotiated  at  various  speeds.  In  addition,  data  were  gathered  about 
how  drivers  control  their  lane  position.  Results  indicated  that  lane  tracking 
in  a  17-deg.  turn  demanded  26  percent  of  the  subject’s  attention  at  20  mph 
(32  km/h)  and  42  percent  at  '9  mph  (64  km/h)  and  that  attentional  demand  in  the 
straightaway  remained  around  23  percent  for  speeds  from  40  to  80  mph  (64  to  129 
km/h).  Lane-tracking  data  indicated  that  the  median  location  was  5  In.  (13  cm) 
to  the  left  of  the  lane  center  in  straightaways,  7  in.  (18  cm)  to  the  left  in 
left  turns,  and  6  in.  (15  cm)  to  the  right  in  right  turns.  Distributions  of 
drift  distances  from  these  three  median  locations  were  also  determined. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1. ,  2. ,  4. 

Spar«  m.  capacity  Subsidiary  task  Experimental  Field  Flight  simulator 
Primary  task  Single  measures  Flight  test 


McDonald,  L.B.  and  Ellis,  N.C.  Stress  threshold  for  drivers  under  various 
combinations  of  discrete  and  tracking  workload.  Proceedings  of  the  19th 
annual  meeting  of  the  Human  Factors  Society,  Dallas,  Texas,  October,  1975 


488-493. 


> 


Stress  thresholds  were  determined  for  drivers  under  various  combinations  of 
discrete  and  tracking  workload.  The  fifteen  subjects  in  the  study  first 
carried  out  a  series  of  tracking  tasks,  and  the  workload  on  each  difficulty  level 
was  measured  with  a  secondary  task .  They  then  executed  a  number  of  discrete 
tasks,  and  the  workload  on  each  difficulty  level  was  measured.  Various  workload 
levels  were  then  combined  in  an  effort  to  discover  the  stress  threshold  for 
different  combinations  of  discrete  and  tracking  tasks.  Study  results  indicate 
that  subjects  are  unable  to  simultaneously  execute  two  tasks,  each  of  which 
occupies  50%  of  their  attention  when  executed  alone.  A  regression  analysis  was 
performed  on  the  data  to  determine  what  levels  of  tracking  workload  can  be 
executed  simultaneously  with  various  levels  of  discrete  task  workload. 


U/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  2.1,  4.2 
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Flight  simulator 
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McDonnell,  J.  D.  Pilot  rating  scales  for  the  estimation  and  evaluation  of 

handling  qualities.  Wright-Patterson  Air  Force  Base,  Ohio:  AFFDL-TR-68-76, 
December,  1976. 

This  document  reviews  existing  rating  scales  used  in  estimating  aircraft 


handling  qualities  sud  workload, 
posed  which  more  nearly  meets  the 

Based  on  background  data  a  new 
criteria  oe  an  interval  scale. 

scale  is  pro- 

W/L  Cat.  Code: 

1.1 

Op.  Beftav.  Code: 

1. ,  2. ,  4. 

Opinion 

Rating  scale 

Construct  Laboratory 

Flight  simulator 

Experimental 

Flight  test 

McFeely,  T.  E.  Pupil  diameter  and  the  cross-adaptive  critical  tracking  task;  A 
method  of  workload  measurement.  Master’s  thesis.  Naval  Postgraduate  School, 
Monterey,  California,  June,  1972.  (AD  749  075). 

Two  new  applications  of  established  techniques  for  measuring  an  individual's 
level  of  stress  (workload)  in  tracking  tasks  are  presented.  An  indirect 
technique  of  measuring  "reserve  capacity"  is  utilized  in  a  two-axis  cross- 
coupled  compensatory  tracking  task.  A  direct  psychophysiological  measurement 
is  made  by  recording  time  histories  of  operator  pupil  diameter.  Results 
obtained  indicate  that  each  method  yields  a  good  index  of  workload,  although 
considerable  variance  in  the  data  is  observed.  The  level  of  instability  in  t.h 
second  axis  of  the  cross-adaptive  method  is  shown  to  be  related  to  the  levex  o 
workload  in  the  primary  axis.  Increased  pupil  diameter  is  shown  to  be  similarly 
related  to  operator  workload.  The  simultaneous  application  of  both  techniques 
is  determined  to  be  inappropriate. 

W/L  Cat.  Code:  2.2.5,  3.1,  4.1.8 

Op.  Behav.  Code;  1.  ,  2.,  4. 
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McGrath,  J.  J.  Temporal  orientation  and  task  performance.  Goleta,  California: 
Human  Factors  Research,  719-IC,  January,  1969.  (AD  758  909). 

This  report  summarizes  a  three-year  program  of  research  on  temporal  orientation 
.and  task  performance.  The  objective  of  the  program  was  to  demonstrate  the 
feasibility  of  relating  man's  perception  of  time  to  his  performance  on  the  job. 
Three  methods  of  manipulating  temporal  orientation  were  used:  measuring 
individual  differences,  varying  the  display  of  time  information,  and  altering 
the  physiological  state  of  the  subject.  Criterion  tasks  were  signal  detection, 
anticipatory  timing,  and  elementary  visual  perception.  The  results  demonstrated 
the  feasibility  of  manipulating  temporal  orientation  as  an  independent  variable 
and  demonstrated  several  relationships  between  these  manipulations  and  task 
performance. 

W/L  Cat.  Code:  2.2.3,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spans  m.  capacity  Time  estimation  Reviev  Laboratory  Background 
Primary  task  Single  measures 


McHugh,  W.  B. ,  Brictson,  C.  A.  and  Naltoh,  P.  Emotional  and  biochemical  effects 
of  high  work-load.  Proceedings  of  t.he  AGARD  Conference  on  Simulation  and 
Study  of  High  Workload  Operations,  AGARD-CP-146,  April,  1974,  A12-1  -  A12-9. 

A  preliminary  longitudinal  rsultifactorial  study  of  the  interrelationships  of 
biochemical,  mood,  biographical  factors  and  landing  performance  under  high  work 
load  conditions  has  been  carried  out  with  U.  S.  Naval  Aviators.  Levels  of  rerum 
cholesterol,  serum  uric  acid,  blood  lactate,  pyruvate,  and  mood  assessments 
were  made  during  periods  of  non-flying  activity  and  during  periods  of  Increased 
cumulative  workload.  Uric  acid  values  fell  during  moderate  cumulative  workload 
and  cholesterol  values  fell  during  high  cumulative  workload.  Increased 
variability  of  pyruvate  and  lactate  were  noted  with  increased  cumulative  work 
load.  Increased  cumulative  workload  did  not  affect  emotions  or  performance  but 
altered  mood  association  patterns  and  altered  the  relatlonshlpr  of  mood  and 
performance.  Experience  was  correlated  with  performance  under  zero  cumulative 
workload  conditions .  Emotion  correlated  with  performance  under  high  cumulative 
workload  conditions. 

W/L  Cat.  Code:  4.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Physiological  Mult,  measures  Review  Flight  test  Flight  simulator 

Flight  test 
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McKenzie,  R.  E,  Assessment  correlates  cf  workload  and  performance.  In  B.  0. 
Hartman  and  R.  E.  McKenrie  (Eds.)  Survey  of  methods  to  assess  workload. 
AGARD-AG-246,  August,  1979,  145-159. 

This  paper  reviews  assessment  correlates,  with  separate  emphasis  on  workload, 
performance,  and  stress.  The  correlates  can  be  divided  into  several  groups: 
physiological  correlates,  psychological  correlates,  stress  correlates, 
psychophyoiologic  correlates,  and  central  nervous  system  (CNS)  correlates.  Each 
group  is  examined  with  respect  to  specific  applicable  techniques. 

W/l.  Cot.  Code:  3.1,  4.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Multiple  Review  None  Background 

Physiological 


McKenzie,  R.  E.,  Buckley,  E.  P.  ,  and  Sarlanis,  K.  An  e.rploratory  study  of 

psychophysiological  measurement  as  indicators  of  air  traffic  control  sector 
workload.  In  B.  0.  Hartman  and  R.  E.  McKenzie  (Eds.)  Survey  of  methods  to 
assess  workload.  AGARD-AG-246,  August,  1979,  129-133. 


There  has  been  a n  ever-increasing  concern  within  the  Federal  Aviation  Agency  for 
the  possible  adverse  effects  of  stress  inherent  in  the  character  of  the  work  of 
Air  Traffic  Control  Specialists  (ATCS).  Since  external  job-related  measures 
do  no  appear  to  offer  satisfactory  criteria,  attention  has  been  turned  to  internal 
operator-related  measures  in  an  effort  to  determine  their  usefulness  in 
evaluating  the  stressors  inherent  in  the  work  of  the  ATCS.  This  study  was  designed 
to  explore  the  possibility  that  certain  physiological  measures  could  be  related 
to  some  aspects  of  the  controller's  task,  namely,  workload  defined  in  terms  of 
number  of  aircraft  (traffic  density),  and  the  occurrence  of  aircraft  conflicts. 
Results  of  this  study  show  that  significant  differences  exist  in  conflict 
detection,  heart  rate,  and  GSR  for  the  two  traffic  densities  examined. 

W/L  Cat.  Code:  3.1,  4.1.2,  4.1.10 


Op .  Behav .  Code :  1.,  2.,  3.,  4. 


Frimary  task  Single  measure  j  Eaipsrimental  Simulato’- 

Physiological  GSR 

Heart  rate, 
n.r.  var. 


Flight  simulator 
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McLean,  J.R.  and  Ho  £  f  maun  v  E.R.  Steering  reversals  as  a  measure  of  driver 
performance  and  steering  ta^k.  difficulty.  Human  Factors,  1975,  17, 

248-256. 

Steering  reversal  rates,  used  ac  a  measure  of  driver  performance,  are  reviewed. 

The  data  from  two  previously  reported  experiments,  carried  out  in  a  controlled 
situation,  are  used  to  compare  steering  reversal  rates  with  other  performance 
measures.  While  steering  reversal  rates  correlate  with  other  measures  of  control 
frequency,  they  do  not  necessarily  correlate  with  measures  of  absolute  sneering 
performance.  Tills  result  is  consistent  with  the  view  chat  frequency  characteristics 
pro\?de  a  measure  of  steering  task  difficulty  raJier  than  steering  performance . 

The  general  problems  of  selecting  measures  of  steering  performance  and  steering 
task  difficulty  are  dircussed.  It  ic  ah>xm  thet,  when  considering  steering  task 
difficulty,  cure  must  be  taken  to  differentiate  between  the  difficulty  impoeed 
by  the  task  constraints,  end  the  factors  which  affect  the  driver's  ability  to 
miintain  s.  level  of  performance  commensurate  with  those  constraints. 

W/L  Cat.  Code.  3.1 

Op,  Behav-  Code:  l.,  2.,  4. 

Primary  task  Single  L'uaeures  Construct  Tield  Flight  simulator 

Experimental  Flight  test 


t-itlfcou,  C.  E.  Workload  and  stress  in  air  traffic  controllers.  In  B.  0.  Hartman 
and  R.  E.  McXenrie  (Eds.)  Survey  of  methods  to  assess  workload.  AC-fRO-AU- 
246,  August,  1979,  137" 144. 

Data  collected  at  14  nir  traffic  control  facilities  regarding  air  traffic  controller 
(ATCS)  workload  and  urinary  stress  indicator  hormone  (S1H)  excretion  la  rev'rwjd. 

The  data  show  a  oignificant  relationship  betwson  objective  workload  measures 
(rndio  transmission  time  and  traffic  tour  and  indexes  of  catecholamine  excretion, 
Mean  epinephrine  excretion  by  ATCSs  at  six  air  tirffic  control  towers  ranging 
fron  very  low  to  very  high  traffic  nensity  v.s  significantly  (?  -  0.96)  related 
to  annual  traffic  counts  at  those,  towers.  The  sympauho-ad' ar.onaduxlary  axis 
that  prepares  the  organism  for  "fight  or  flight"  described  by  W  B.  Cannon  Iv. 

1929  apparently  is  applicable  to  alCSs.  The  question  of  underload,  optimum  load, 
and  overload  is  discussed. 

W/L  Cat .  Code :  3.1,  4.1.12 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 
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Melton,  C.  E.,  Sal  h,  R.  C. ,  McKenzie,  J.  M. ,  Hoffmann,  S.  X.,  a> d  Saldivar, 

J.  T.  Straas  in  air  era?  c  controllare-affacta  of  ARTS  III-a utoaated  radar 
terminal  eye tame.  Avlat-n,  Space,  and  Environmental  Medicine,  1976,  47, 
925-930. 


Physiological,  biochemical,  and  psychological  aasassments  of  stress  in  air  traffic 
controllers  ware  made  at  Los  Angsles  (LAX)  and  Oakland  (OAK)  Terminal  Radar 
Approach  Control  TRACON)  facilities  before  and  after  installation  of  Automated 
Radar  Terminal  Systems-ICI  (ARTS-III).  Heart  rates  of  controllers  on  duty  or  at 
rest  scarcely  changed  from  before  to  after  ARTS-III  installation.  Total  stress 
increased  at  both  TRACONs,  and  the  increase  was  entirely  due  to  elevated  catecholamine 
excretion.  Steroid  excretion  was  significantly  reduced  at  both  facilities  after 
ARTS-III  installation.  Scores  on  the  A-State  scale  of  the  State-Trait  Anxiety 
Inventorv  indicated  that  introduction  of  ARTS-III  had  no  appreciable  effect  on 
work-related  anxiety  levels  of  controllers.  The  poct-ARTS-IIT  A-State  means  for 
both  facilities  were  not  significantly  elevated. 


W/L  Cat.  Code:  l.t,  4.1.10,  4.1.12 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 
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Flight  simulator 
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Melton,  C.  E. ,  Smith,  R.  C.,  McKenzie,  J.  M. ,  Wicks,  S.  M. ,  and  Silver,  J.  T. 

Stress  in  air  traffic  personnel:  low-density  towers  and  flight  services. 
Oklahoma  City,  Oklahoma:  Federal  Aviation  Administration,  FAA-AM-72-73, 
September,  1977.  (AD  A046  826). 

Stress  and  anxiety  levels  were  measured  in  10  air  traffic  control  specialists 
(ATCS)  at  two  low-traffic-density  towers  and  in  24  flight  service  (FS)  specialists. 
Physiological  measurements  consisted  of  heart  rate  and  urine  biochemical  analysis 
for  17-ketogenic  steroids,  epinephrine,  and  norepinephrine.  Cn-duty  arousal  in 
ATCS's  and  FS  specialists  ««s  evident  both  physiolgically  and  psychologically; 
such  arousal  was  within  psychologically  normal  limits  and  was  generally  low 
physiologically.  It  is  concluded  that  it  is  inappropriate  to  describe  all  air 
traffic  control  work,  as  is  commonly  done  in  the  popular  press,  as  unusually 
utreasful. 


W/7.  Cat.  Code: 

Op.  Behav.  Code: 

Opinion 
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Merhav,  S.  J.  and  Ya'acov,  0.  B.  Control  augmentation  and  workload  reduction  by 
kineathmt.ic  information  from  the  manipulator*  Proceedings  of  th«  12th  Annual 
HASA-Onlveralty  Conference  on  Manual  Control.  Unlveralty  of  Illinois,  Kay, 

1976,  361-379.  (NASA  TM~£7T  lf&)  . 

This  paper  la  concerned  with  control  augmentation  and  workload  reduction  by  means 
of  kinesthetic  information  provided  by  the  manipulator.  The  control  stick  is 
loaded  by  a  torque  motor  and  the  syatem  la  so  interconnect'd  that  it  presents 
complete  kinesthetic  input  and  output  information  from  the  controlled  plant.  Thus, 
the  control  taak  involves  the  same  kinesthetic  cues  and  the  low  workloed  as  in 
nonintermediary  handling  of  obje:ts*  It  la  demonstrated  that  within  20  rad/sec, 
which  la  the  effective  bandwidth  in  manual  control,  the  method  la  realizable  for 
a  large  varlwty  of  planta  which  may  be  unstable  and  time  varying.  Tracking  end 
regulating  teats  demonstrate  that  very  substantial  Improvements  in  accuracy  and 
reduction  in  workload  are  obtained  in  comparison  with  ordinary  isotonic,  isomorphic 
or  Isometric  manipulators.  A  test  for  the  fixed  set  point  regulation  task  involving 
a  second  order  plant  reveals  that  the  control  force  law  Involved  Is  strikingly 
similar  to  that  of  a  linear  regulator  with  un  energy  constraint  obeying  a  quadratic 
performance  criterion.  The  corresponding  theoretical  closed  loop  transfer  function 
Is  in  agreement  with  known  linear  models  of  the  manual  neuro-muscular  system. 

W/L  Cat.  Code:  2.  A,  3.1 

Op.  *;ehdv.  Code:  1.  ,  2.  ,  4, 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Meyer,  R.  E.  Stress  and  the  air  traffic  controller.  Revue  de  Medicine 
Aeronautique  et  Spaciale,  1974,  1J,  97-106. 

The  flight  controller's  task  requires  continuous  vigilance,  possibly  for  extended 
periods  without  a  break.  A  significant  factor  to  be  borne  in  mind  is  that  the 
individual  controller  has  no  control  over  his  rate  of  work.  It  has  been  recorded 
that  with  Increasing  traffic  density,  controllers  are  able  to  maintain  a  high 
performance  level  but  that  as  they  do,  the  stress  level  rises  accordingly  and  the 
ultimate  safe  tolerance  level  becomes  the  limiting  factor  on  the  system.  It  is 
shown  that  this  taok  level  is  net  the  only  serious  source  of  stress  but  that  other 
factors  such  as  noitfe,  the  effects  of  shift  work,  faintly  problems,  and  others 
all  contribute  in  varying  degrees  to  the  operator's  workload.  It  must  be  kept 
firmly  in  mind,  however,  that  whatever  his  loading  is,  he  must  still  attain  the 
highest  degree  of  safety  that  is  humanly  possible. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 
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Michon,  J.  A.  A  note  on  the  measurement  o?  perceptual  motor  load.  Ergonomics, 
1964,  7,  461-463. 

This  note  describee  u  method  of  measuring  the  perceptual  aotor  load  (PML7  of 
tasks  in  which  activity  is  negligible,  and  the  input  and  processing  of 
perceptual  data  is  the  Important  thing.  The  method  involves  a  tapping 
(interval  production)  teak  that  la  measured  for  regularity.  Comparisons 
are  made  between  task  scores  and  both  subject  and  expert  ratings.  Agreement 
is  good. 

W/L  Cat.  Code:  1.1*  2.1.2,  2.2.2 

Op.  Rehav.  Code:  1.,  2.,  4. 
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Kichon,  .7.  A.  Tapping  regularity  as  a  measure  of  perceptual  motor  load. 
Ergonomics,  1966,  9,  401-412. 


Numerous  methods  have  been  devised  to  measure  perceptual  load.  Unfortunately 
the  concept  itself  is  ill-defined,  which  makes  different  approaches  practically 
incomparable.  The  central  problem  is  the  ordering  of  tasks  of  different  types. 
Most  methods  compere  tasks  that  differ  only  in  one  variable,  such  as  speed  or 
input/output  uncertainty.  There  are  however  methods  which  can  be  applied  to 
a  wider  range  ct  tasks.  One  such  approach  observes  the  timing  of  successive 
actions:  load  will  cause  "traffic  control"  problems  in  the  central  nervous 
system,  so  that  actions  will  be  executed  in  an  irregular  fashion.  The  use  of 
Irregularity  as  a  measure  of  perceptual  load  depends  on  the  availability  of  a 
"functional"  descriptive  system  of  behaviour,  as  opposed  to  current  "phenomenal" 
systems  like  those  of  time  and  motion  study.  A  convenient  substitute  xa  that 
of  measuring  the  irregularity  of  a  subsidiary  performance.  Key  tapping  was 
found  to  satisfy  certain  methodological  requirements.  Some  experiments 
evaluating  this  method  are  discussed. 

W/L  Cat.  Code:  2.2,2 

Op.  Behav.  Code:  1.,  2.,  4. 
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Michon,  J.  A.  and  Doorne,  H.  van  Equipment  note:  A  semi-portable 

apparatus  for  the  measurement  of  perce  tual  motor  load.  Ergonomics, 
1967,  10,  67-72. 

A  device  is  described  which  makes  it  possible  to  record  the  intervals 
produced  by  a  subject  in  a  method  for  measuring  perceptual  motor  load. 
Ibe  system  is  specially  adapted  for  ; ield  work  and  operating  under 
difficult  electrical  conditions. 


W/L  Cat.  Code:  2.2.2 

Op .  Behav .  Code :  1 .  ,  2 . ,  3  . ,  4 . 
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Miller,  R.  G.  and  Rubin,  R.  T.  Stress  of  aircraft  carrier  landings.  1. 

Corticosteroid  responses  in  Naval  aviators.  San  Diego,  California: 

Navy  Medical  Neuropsychiatric  Research  Unit,  Report  No.  NMNRU-70-16, 

April,  1970. 

Serum  and  urine  cortisol  levels  were  measured  in  Navy  pilots  and  theit  flight 
officers  during  aircraft  carrier  landing  pract.c*  in  the  two -man  F-.'B  jet 
aircraft.  The  pilots  showed  a  considerably  adrenal  cortical  stress  response; 
the  flight  officers  did  not.  The  complex  and  danger. ~us  task  of  carrier  landing 
appears  to  be  a  greater  stress  on  tne  pilot  in  control  of  the  aircraft  than 
on  his  passive  partner.  These  findings  suggest  that  in  acute  stress  situations, 
assigned  role  and  responsibility  may  be.come  dominant  factor?  in  the  hierarchy 
of  psycboendocrinu  control  of  adrenal  cortical  responses.  As  a  possible 
reflection  of  central  norepinephrine  metabolism  urine  MHPG  excretion  was 
measured  in  naval  aviators  during  aircraft  carrier  landing  practice,  a  complex 
task  and  a  stress  of  considerable  magnitude.  Mean  urine  MHPG  was  significautly 
increased  after  both  day  and  night  carrier  landings  compared  to  a  nonflying 
control  day.  These  findings  suggest  that  there  may  be  an  accelerated  metabolism 
of  brain  norepinephrine  under  conditions  of  heightened  arousal  and  concentration 
compared  to  the  normal  waking  state. 

W/i»  Cat.  Code:  4.1.12 

Op.  Behav.  Code:  1.,  2.,  4. 
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Milord,  J.  T.  and  Perry,  R.  P.  A  methodological  study  of  overload.  Journal  of 
General  Psychology,  1377,  JJ7,  131-137. 


The  purpose  of  this  research  is  to  establish  a  methodology  for  studying  stimulus 
overload  In  the  psychological  laboratory.  It  is  argued  that  to  maximize  the 
conditions  of  overload  in  simulation,  the  dimensional  criteria  of  maximal  intensity, 
maximal  diversity,  and  minimal  patterning  must  be  Included  in  the  methodology. 

In  addition,  it  is  suggested  uiat  the  psychological  phenomenon  of  overload  be 
operationally  defined  in  terns  of  the  individual's  perception  of  overload  rather 
than  the  input-output  capacity  of  the  system.  College  students  performed  either 
an  overload  or  no  overload  version  of  a  proofreading-vigilance  task,  a  driving- 
memory  task,  or  a  computation-interruption  task.  The  driving-memory  task,  which 
was  Intended  to  be  most  extreme  on  the  dimensions  nf  intensity,  diversity,  and 
patterning,  was  perceived  as  the  most  overloading  of  the  three  experimental  tasks. 
This  led  to  the  conclusion  that  this  driving-memory  task  represented  a  substantial 
improvement  over  existing  methods. 
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rate  irregularity  as  a  measure  of  mental  workload  in  the  steel  industry. 
London,  England:  British  Steel  Corporation,  BISRA,  OR/HF/25/71,  August, 


*■ 


1971. 


An  experiment  is  reported  in  which  heart  rate  was  recorded  while  subjects 
performed  a  mental  task  that  was  varied  in  "complexity"  and  presented  in  several 
paced  and  unpaced  conditions.  The  relationships  between  twelve  conditions  of 
mental  load  aud  heart  rate  irregularity  are  discussed.  Another  experiment  examines 
the  relationship  between  heart  rate  irregularity  and  physical  load  on  a  bicycle 
ergometer.  A  third  experiment  is  reported  in  which  subjects  repeated  the  same 
exercises  on  a  bicycle  ergometer  on  3  separate  days.  The  results  of  these 
experiments  are  discussed,  with  special  reference  to  previously  reported  influences 
of  respiratory  rnte  and  depth  on  heart  rate  irregularity. 
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Monty,  U.  A.  and  Ruby,  W.  J.  Effects  of  added  workload  or*  compensatory 

tracking  for  iraximu-.  terrain  ioilowing.  Hrnxan  Factors,  1965  ,  2»  207-214. 

The  relative  merits  of  presenting  «-.ch  of  two  command  signal*  (6e,  the 
elevator  deflection  angle,  and  r,  tha  aircraft  flight-vector  angle)  on  a 
compensatory  display  for  manual  control  of  a  simulated  aircraft  on  a  terrain- 
following  mission  were  examined.  It  waa  found  that  imposing  additional  work¬ 
loads  on  tha  pilot  led  to  a  greater  decrement  in  tracking  performance  with 
the  y  command  than  with  the  6e  command.  Further,  the  workload  tack  itself 
wan  performed  with  greater  proficiency  while  tracking  with  the  6e  command. 

Tha  apparent  merits  of  the  command  warrant  further  investigation. 


W/L  Cot.  Code:  2.2.1,  3.1 
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Moray,  N.  Where  is  capacity  limited?  A  curvey  and  a  model.  Acta  Psychologic*, 
1967  5  27,  84-92. 


A  model  is  presented  for  the  limitations  of  processing  information  by  the  human 
operator  which  proposes  that  he  acts  not  as  a  limited  capacity  channel  with  fixed 
capacity,  but  as  a  limited  capacity  processor.  The  total  capacity  of  the  broin 
can  be  allocated  to  the  separate  aspects  of  the  tasks,  such  as  reception,  recoding, 
emission,  storing,  etc.  Hence  from  moment  to  moment  the  size  of  the  ’channel* 
in  the  Shannon  sense  will  appear  to  vary.  In  particular  parallel  processing  is 
possible  where  the  total  capacity  is  not  exceeded y  and  where  there  is  high 
compatibility.  Experimental  evidence  In  support  of  the  modal  la  preaectad. 


W/L  Cat,  Code: 

Op.  *hav.  Code: 
Spare  m,  capacity 


2.1.2 
1.,  2. 

Inform,  theory 


Construct 


Laboratory  Background 


Experimental 


'  i 


\  \ 


I 

f 


SY'2?R-80 


Moray,  N.  Attend ton,  control,  end  sampling  b-UMrlor.  In  T.  B,  Sheridan  and 
a.  Jcharmsen  (Eds.)  Moni  toring  behav  ior  and  supervisory  control.  New  York; 
lenua,  1976,  221-243. 

A  critical  review  of  attention  rnd  sampling  behavior  1b  presented.  The  two 
approaches,  cognitive  psychology  and  Information  processing  are  first  reviewed. 

It  Is  then  suggested  that  by  developing  internal  models  of  the  human  operator, 
differences  in  tho  two  approaches  can  be  reconciled.  Cme  of  the  major  problems 
confronting  internal  model  formulation  is  that  of  parameter  measurement.  It  ie 
that  snactral  techniques  are  among  the  most  powerful  In  paremeter 
d*  terminetioc:. 

W/V  Cat.  Code:  3.1,  3.3 

Cp.  Eehdv.  Code:  1.,  2.,  4. 

Primary  task  Single  mea;  ureA  Review  None  Plight  rlranlator 
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Morey,  N.  Models  and  measures  of  mental  workload.  In  N.  Moray  (Ed.)  K?uva2 
Korkloal:  Its  theory  and  measurement..  New  York:  Ple-.rcm  Press,  lb79,  .13-21. 

Systematic  and  careful  study  of  the  formal  relation  between  normative 
measures,  and  a  corresponding  empirical  analysis  of  the  interrelation  of 
the  scores  of  the  different  empirical  measures  (including  physiological 
ones)  are  needed.  Just  us  each  normative  model  gives  an  "ideal"  ocore,  rso 
should  they  provide  normative  in'reruorrtlatlosv?.  /n  tnomous 
practical  step  would  have  beer  taken  if  era  could  specify  the  boundary 
conditions  within  will  h  measures,  models,  and  intercorrelations  are  effective 
and  can  be  relied  on. 
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Ms  Tjjan ,  B.  B. ,  Jr,,  Coates,  0  P. ,  AJlulel,  E.  A.,  and  Kirby,  R.  H.  The  teaQ- 
Craining  load  ao  a  pa&xmettr  of  effectiveness  for  collective  training  in  units. 
Norfolk,  Virginia-  01,1  Dominion  University,  Performance  Assessment  Laboratory, 
Technical  kepovt  ITR-78-14,  May,  1978. 

This  report  aumnarises  the  results  of  two  groups  of  studies  of  team  training. 

Tti  each  of  ten  studies,  five  subjects  worked  together  as  a  team  for  eignt  hours 
per  day  over  six  consecutive  days;  during  their  first  48  hours  of  work,  each 
tea*  vms  trained  to  perform  the  six  tasks  that  constitute  the  synthetic  work 
oresented  with  the  Multiple-Task  Performance  Battery.  The  teams  consisted  of 
different  combination*  cf  the  total  of  20  undergraduate  male  volunteer  subjects 
to  provide  team- training  loads  (percentages  of  untrained  team  personnel)  ranging 
from  0  to  100  percent  in  20  percent  steps.  The  data  of  the  10  studies  were 
combined  tc  permit  analysis  of  the  effects  of  team-training  loads  ranging  from 
0  to  100  percent  in  10  percent  steps,  and  the  effects  of  team-training  load  on 
tr-vlnlng  uni  performance  effectiveness  were  therby  assessed. 

W/L  Cat.  Code:  i.l 

Op.  B&h&v.  Oocfc.  1,,  2.,  4. 

Primary  tan’.  Single  measures  Experimental  L  aboratory  Flight  simulator 
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Jw'rgan,  T.  R.  Inflight  physiological  data  acquisition  svstem.  Brooks  AFB, 

Texas:  USA?  School  cf  Aerospace  Medicine.  SAM-TR- 75-46,  December,  1975. 

An  inflight  physiological  data  acquisition  system,  for  use  in  recording  selected 
biomedical  and  environmental  parameters  of  flight,  has  recently  completed  final 
development .  The  system  employ*  an  instrumented  oxygen  mask  which  inputs  to 
si'.gnal-procecaing  and  recorder  packages  positioned  in  conveniently  accessible 
cockpit  areas,  or  in  pockets  of  the  crewmember’s  survival  vest.  The»o  subunits 
are  of  sufficiently  flexible  configuration  to  be  fully  compatible  with  the 
hr  ad  spectrum  of  military  cockpits  aud  can  monitor  a  variety  of  parameters, 
including  accessible  lung  volumes  (such  as  tidal  volume,  minute  volume,  ar.d 
forced  vital  capacity),  oxygen  consumption.,  ECO  activity,  G3,  cabin  pressure,  an 
internally  generated  time-code  signal,  and  voice  communications.  Information  is 
recorded  on  cassette  tape  for  subsequent  retrieval  and  analysis  by  greund-based 
data  reduction  equipment.  The  system  is  expected  to  prove  useful  in  establishing 
breathing-ayptem  design  criteria  and  assessing  biomedical  stresses  cf  flight. 
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Morrisaatte,  J.O.,  Crannell,  C.W.  and  Switzer,  S.A.  Group  performance  under 
varioua  conditions  of  work  load  and  Information  redundancy.  Wright-Patterson 
AFB,  Ohio:  Aerospace  Medical  Research  Laboratory,  AKRv,-TR-65-16,  April,  1965. 
(AD  615  376). 


The  objective  of  the  present  study  were:  (a)  to  determine  the  counteracting  effect 
of  work  load  (W)  and  informational  redundancy  (R)  on  performance,  and  (b)  to 
determine  the  performance  of  groups  of  individuals  working  cooperatively  with 
groups  of  individuals  working  independently,  under  various  conditions  of  work 
load  and  informational  redundancy  (W-R) .  Sex  differences  were  also  considered. 
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Subsidiary  task  Experimental  Laboratory  Background 
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Mourant,  "...  R.  and  Rockwell,  T.  H.  Mapping  eye-movement  patterns  to  the 
visual  scene  in  driving:  an  exploratory  study.  Human  Factors,  1970,  12, 

81-87. 

Eye  movements  of  eight  drivers  were  filmed  as  ».he  drivers  traveled  on  a  local 
expressway  at  50  mi.  per  hour.  Search  and  scan  patterns  of  the  drivers  became  more 
compact  and  the  center  of  location  shifted  down  and  to  the  left  as  the  drivers 
became  more  familiar  with  the  route.  The  center  of  the  final  pattern  was  located 
above  the  right  road  edge  marker  and  slightly  higher  than  the  horizon.  The  search 
and  scan  patterns  verified  that  the  peripherei  area  of  the  eye  is  used  for  monitoring 
lane  position,  other  vehicles,  and  road  slgm<  no  that  the  fovea  may  be  directed 
for  a  closer  examination  when  the  situation  demands  i 

W/L  Cat.  Cole:  4.1.7 
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Mulder,  G.  Mental  load,  mental  effort  and  attention.  In  N.  Moray  (Ed.) 
Mental  workload:  its  theory  and  measurement.  New  York:  Plenum  Press, 
1979,  299-325. 


This  paper  provides  a  summary  of  many  of  the  widely-used  techniques  cf  workload 
estimation.  Conceptually,  mental  workload  can  be  coopered  with  physical  workload. 
Whereas  in  physical  workload  maximum  intake  of  oxygen  is  an  important  lioiiting 
factor,  in  mental  workload  processing  capacity  is  a  limiting  factor.  To  measure 
mental  workload  secondary  tasks  may  be  used.  Additionally  mental  workload  nay 
be  measured  by  "strain",  that  is  physiologically.  Newer  concepts  involve 
Information  processing  models  and  other  "internal"  models  of  humans. 

W/L  Cat.  Code:  2.2,  3.3,  4.1 
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Mulder,  G.  Sinusarrhythmla  and  mental  work  load.  In  N.  Moray  (Ed.)  Mental 
workload:  its  theory  and  measure went.  New  York:  Plenum  Frees,  1975, 
327-343. 


Sinusarrhythmla  has  been  associated  with  respiration.  In  the  last  decade  Insight 
has  beer  obtained  into  the  mechanisms  underlying  this  phenomenon.  Spectral 
analysis  has  been  applied  and  reveals  the  different  mechanisms  involved.  This 
paper  reviews  and  integrates  the  present  state  of  knowledge  of  sinusarrhythmla 
and  its  relationship  to  certain  classes  of  mentis  workload. 
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Mulder,  Q.  end  Mulder-Hajonidea  van  der  Meulen,  W.  R.  E.  H.  Mental  load  and 
the  measurement  of  heart  rate  variability.  Ergonomics,  1973,  16,  69-83. 

A  number  of  studies  concerning  heart  rate  variability  and  mental  load  are 
reviewed.  It  is  concluded  that  in  paced  choice  reaction  tasks  the  number  of 
reversal  points  in  the  cardlot echogram  is  the  most  sensitive  measure  of  the 
load  of  the  task.  This  measure  was  strongly  correlated  with  respiration. 
Spectral  analysis  of  heart  rate  variability  revealed  the  existence  of  a 
frequency  component  at  about  0*10  He,  a  respiration  frequency  and  sometimes 
a  tusk  frequency.  In  a  number  of  tasks  the  respiration  frequency  increased, 
and  the  amplitude  of  energy  in  the  lower  frequencies  decreased  (i.e. ,  there 
was  a  decrease  in  heart  rate  variability). 
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Murphy,  J.V,  and  Gurman,  B.S.  The  integrated  cockpit  procedure  for  identifying 
control  and  display  requirements  of  aircraft  in  advanced  time  periods. 
Proceedings  of  the  AGARD  Conference  on  Guidance  and  Control  Displays, 

AGARD- CP-96,  4-1  -  4-7.  (AD  739  779). 

The  Integrated  Cockpit  Research  Procedure  (ICRP)  was  used  to  define  cockpit 
control  and  display  requirements  for  the  next  generation  utility  transport 
helicopter.  A  control  and  display  requirements  analysis  was  conducted  based  upon 
the  derivation  of  specific  functions  necessary  for  accomplishing  four  specified 
missions.  In  turn,  control/display  mechanization  vas  derived  from  specific 
mission  functions.  A  Time-Based  Load  Analysis  (TBLA)  was  used  as  an  evaluation 
tool  to  provide  a  quantitative  index  of  operator  load.  A  Load  Analysis  was 
performed  utilizing  computer  processing  techniques  to  make  task  adjustments  in 
real  time.  The  technique  also  provided  an  analysis  of  contingency  situations 
and  denoted  overload  conditions  that  occurred.  The  hard  copy  mock-up  was  a  full- 
scale  cockpit  shell  in  which  the  alternative  mission  control/display  configurations 
could  be  illustrated. 
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Murphy,  M.  R.  Coordinated  crew  performance  in  commercial  aircraft  operations- 
Proceedings  of  the  21at  Annual  Meeting  of  the  Human  Factors  Society.  San 
Francisco,  California,  October,  1978,  4x6-470. 

A  critical  need  for  an  improved  system  of  coding  and  analyzing  crew  member 
interaction  is  identified  and  a  specific  methodology  suggested.  The  complexity 
and  lack  of  precirion  of  many  crew  and  task  variable  j  s^gest  the  utility  of 
fussy  linguistic  techniques  for  modeling  ar.d  computer  simulation  of  the  crew 
performance  process.  Other  research  methodologies  and  concept*  that  have 
promise  for  increasing  the  efficacy  of  research  07  crew  peffomact  are 
identified. 
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Murphy,  M.  R.  Analysis  of  eighty-four  commercial  aviation  incidents:  implications 
for  a  resource  management  approach  to  crew  training.  Proceedings  of  the  1980 
Annual  Reliability  and  Maintainability  Symposium,  San  Francisco.  California. 

June,  1980. 

A  resource  management  approach  to  air  crew  performance  is  defined  and  utilized 
in  structuring  an  analysis  of  84  exemplary  incidents  from  the  NASA  Aviation  Safety 
Reporting  System.  The  distributions  of  enabling  and  recovery  factors  between  and 
within  five  analytic  categories  suggest  that  resource  management  training  he 
concentrated  on:  1)  interpersonal  communications,  with  Air  Traffic  Control  (ATC) 
Information  of  major  concern;  2)  task  management,  mainly  setting  priorities  and 
appropriately  allocating  tasks  under  varying  workload  levels;  3)  planning,  coordina¬ 
tion,  and  decisionmaking  concerned  vivh  preferring  and  re-overinq  froc  potentially 
unsafe  situations  in  certain  aircraft  maneuvers.  Problet  solving  and  leadership 
skills  we?  a  Implicated  as  factors  in  a  sufficient,  number  of  incidents  to  require 
further  study.  Leadership,  social  skills,  and  role-i^sue  effects  may  be  under- 
reported  in  voluntarily  submitted  incident  data;  more  systematic  study  is  re¬ 
commended.  Some  problem  areas  are  identified  for  which  design  changes  are 
apparently  in  order,  particularly  the  ATC  Interface. 
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Murphy,  M.R.,  McGee,  L.A. ,  Palmer,  E.A. ,  Paulk,  C.H.  and  Waaq>e,  T.E. 

Simulate?  evaluation  o£  three  situation  and  guvitinc*?  disnl  ayo  Ter  V/STOL 
zere/zero  landings.  Proceedings  of  the  10th  Annual  NASA-Unlverslty  Conference 
on  Manual  Control,  Wiight-Patt;yraon  AFB,  Ohlop  April  9-11,  1974. 

A  simulator  study  was  conducted  to  compare  and  evaluate  design  features  of  3 
electronic  displays  for  potential  application  to  V/STOL  aero-2ero  landings, 
the  RAE  proposed  combined  transition  display,  the  Saab  perspective  display,  and 
the  -Teldix  hover  display.  Objective  measures  were  obtained  of  tracking 
performance,  attitude  variability,  end  control  activity  and  were  analyzed  by 
an  analysis  of  variance.  Pilot  opinion  was  also  obtained.  It  was  concluded 
that  (1)  the  RAE  display  is  less  affective  than  the  Saab  or  Teldix  displays 
for  localizer  tracking,  (2)  pilot  workload,  as  indicated  by  rms  variability 
measures,  was  lowest  with  the  Saab  display  and  highest  with  the  Teldix  display, 

(3)  time  to  capture  was  shortest  with  the  Teldix  display  and  longest  with  the 
RAE  display,  <4>  extensive  central  clutter  on  the  Teldix  display  probably 
resulted  in  its  being  given  the  lowest  pilot  opinion  rating,  and  (5)  pilot 
opinion  favor ire  the  RAE  display  over  the  Saab  display  was  at  variance  with 
objective  performance  measures. 

W/L  Cat.  Code:  1.2,  3.1 

Op  tehev.  Code:  1.,  2.,  4- 

Opinion  Questionnaire  Experimental  Flight  simulator  Flight  simulator 

Primary  task  oingle  measures  Flight  test 


Murrell,  J.  F.  Pilot’s  assessment  of  their  cvckoit  environment.  In  Problems 
of  the  Cockpit  Environ*  ant ,  AG‘RD  Conference  Proceedinas  No.  55.  March. 

I97C  .  ir-T^q57~TBT7C5  3*9) . 

Assessment  by  the  user  pilot  is  an  Important  souice  of  information  re  to  tVr. 
efficiency  of  aircraft  display  and  CvV.trol  &vscem3.  Much  information  can  be 
gained  and  reduced  to  quantitative  form  by  roe  cf  open-ended  questions.  In 
the  study  reported,  229  civilian  airline  pilots  represent inp,  oir  a  different 
aircraft  types,  responded  to  five  open  ended  questions  about,  derigr.  and 
layout  of  their  cockpit.  Pilots  flying  different;  types  cf  aircraft  agreed 
in  the  frequency  of  thi*  »*  cowmen  s  and  criticisms.  They  met.  often  criticized 
their  radio  and  navigation  tub.  Application  of  ttase  results  is  discuered 
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Nagsraja  Kao,  P.  K.  and  Griffon,  M.  J.  Secondiry  tank  performance  of 
helicopter  pilots  io.ri.ng  low-le^el  flight.  University  of  South-*apton, 
Institute  of  Sound  and  Vibration  Research,  Report  No.  1T7R-TR-54, 
December,  1971. 

An  Investigation  has  been  wide  into  the  changes  In  performance  at  a  complex 
reaction  time  teak  during  helicopter  flight.  The  two-choice  reaction  tine 
task  employed  required  response*  to  a  continuous  tone  and  a  similar  tone 
pulsed  vith  a  6  Hz  repetition  frecuency.  Eight  pilrts  flew  two-hour  flights 
consisting  of  15  ir’inutrc  at  1000  ft.,  90  minutes  at  100  ft.  and  a  further 
15  minutes  at  iOOO  ft.  The  task  was  presented  at  an  average  interval  of  one 
and  a  half  minutes  throughout  the  two-hour  pariod. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  4.2 


•  Spare  m.  capacity  Subsidiary  task  Experimental  Flight  tesc  Flight  simulator 

Flight  test 


Nakamura,  M  ,  Ok&ue,  M. ,  and  Hori,  H.  The  change  of  heart,  -ate  during  we-tal 
vork.  Tokyo,  Japan:  Japan  Air  Self  Defense  Force,  Aeromtutcal  laboratory 
Repot ts ,  1974,  JL4,  181-190.  (In  Japanese.) 

Experiments  were  performed  to  evaluate  the.  change  of  heart  rate  during  mental 
work.  Two  cases  of  heart  rate  were  tested:  one  at  the  time  of  resea; eh  pre¬ 
sentation;  the  other  of  personal  behavior  under  the  anxiety  states.  The  following 
results  were  obtained:  a  rapid  increase  in  heart  rate  was  observed  when  the 
experiment  began,  with  the  rate  decreasing  immediately  after  it  was  finished. 

When  the  method  of  systematic  desensitization  was  administered,  the  heart  rate 
Increment  was  observed  along  with  muscle  tension.  The  heart  rate  is  affected 
by  emotions,  but  by  training,  it  is  possible  that  the  change  of  heart  rate  can  be 
reduced  gradually.  It  is  possible  that  anxiety  can  be  suppressed  by  controlling 
one's  own  heart  rate. 

W/L  Cat.  Code:  4.1.9,  4.1.10 

Op.  Behav.  Code:  1.,  2., 

Physio logS ~al  Muscle  tension  Experimental  Laboratory  Flight  simulator 

Heart  rate, 
h.r.  var. 


* 

i. 


1 
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NAS/i-Am.  .  Research  Center.  Secondary  task,  for  full  flight  simulation  Incorporating 
tasks  what  commonly  cause  {.  lot  error:  Time  estimation.  Moffett  field. 
California.  NASA-TM-X-74153,  October,  1975. 

The  objective  of  this  joint  research  program  was  to  provide  human  factors 
investigators  with  an  unobtrusive  and  minimally  loading  additional  task  that 
is  sensitive  to  differences  in  flying  conditions  and  flight  instrumentation 
associated  with  the  main  task  of  piloting  an  aircraft  simulator.  The 
additional  task  under  investigation  vas  time  estimation,  an  activity 
occasionally  performed  by  pilots  during  actual  flight.  Previous  research 
indicated  that  the  duration  and  consistency  of  time  estimates  is  associated 
with  the  cognitive,  perceptual,  end  motor  loads  imposed  by  concurrent  simple 
task'.  The  present  research  was  aimed  at  clarifying  the  relationship  between 
the  length  and  variability  of  time  estimates  and  concurrent  task  variables 
under  a  more  complex  situation  involving  simulated  flight. 

W/L  Cat  Code:  2.2.3 

Up.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Time  estimation  Experimental  Flight  simulator  Flight  simulator 

Flight  test 


Nataupsky,  M. ,  Schwanlc,  J.  C.  H.,  Griggs,  E.  B. ,  McKay,  K.  E. ,  Jr.,  and 
Schmidt,  S.  D.  Effect  of  pretraining  criterion  on  flight  simulator  and 
secondary  cognitive  task  performance .  P$x . Bfcdlngs  of  the  23rd  Annual 
Meeting  of  the  Human  Factors  Society,  Boston,  Massachusetts,  October  29- 
Ncvesfoer  1,  7.3  79 ,  305—309. 

Twenty-eight  cadets  were  trained  in  a  flight  simulator  under  one  of  four 
experlu  ntal  groups.  The  groups  were  defined  first  by  having  heading  information 
either  provided  by  the  normol  heading  indicator  or  by  peripheral  lights  and 
second  by  their  being  trained  on  either  a  5°  or  a  10°  heading  deviation  criterion. 
All  cadets  were  subjected  to  four  levels  of  a  seconder*  cognitive  task  plus  a 
control  condition.  There  were  no  significant  differences  for  either  the  main 
effect  of  heading  indicator  type  or  criterion  level  of  training.  The  main  effect 
of  cognitive  task  difficulty  .level  was  significant  for  most  measures.  In  addition, 
the  heading  indicator  type  by  training  criterion  level  interaction  produced 
significant  differences.  The  study  seems  to  indicate  that  training  criteria  are 
important  independent  variables  in  complex  psychomotor /cognitive  flight  simulator 
tasks. 

W/L  <"it.  Code: 
jp.  Behav.  Code: 

Spare  m.  capacity 

Primary  task 


209 


«*• 


2.2.1,  3.1 
1.,  2.,  4. 

Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Single  measures  Flight  test 


SY-17R-B0 


Ravon,  C.  and  Gopher,  D.  On  the  economy  of.  the  buun  processing  ayatev.:  A  model  of 
multiple  capacity.  Haifa,  Israeli  Tectmlon  Technical  Report  AFOSR-77-1,  1977. 

(AD  A059  575). 

An  approach  to  hujian  performance  which  ia  baaed  on  econom.' •*.  concepts  is  proposed. 

This  approach  hinges  on  the  idea  that  the  human  processing  ayatea  hau  a  number  of 
aecheriaaa  each  having;  lta  own  capacity.  Those  capacities  cun  ct  ai.y  moment  be 
allocated  among  several  processes.  Since  tasks  may  differ  with  respect  to  the 
types  of  mechanisms  they  cal!  for  and  the  uenania  they  pose  i:or  the  use  of  those 
mechanisms,  it  la  argued  that  the  hope  to  find  jingle  measures  for  system  capacity 
and  mental  load  may  ba  groundless.  Different  pairs  of  time-shared  tasks  may 
conflict  with  a*eh  other  to  a  variable  degree,  which  it  difficult  to  predict  without 
knowing  the  overlap  in  thair  demand  for  various  mechanisms.  The  amount  and  specific 
nature,  of  trade-off  between  time— shared  tasks  can  he  displayed  by  means  of  performance 
operating  characteristics.  The  effects  uf  s  number  of  properties  of  the  system  and 
of  the  tasks  oil  the  shape  and  interpretation  of  performance  operating  characteristics 
are  discussed.  The  analysis  in  this  paper  also  serves  to  elucidate  the  notion  of 
resources  brought  forward  by  previous  authors,  to  elaborate  on  the  distinction 
between  demand  for  and  supply  of  resources,  to  discuss  possible  interactions  between 
the  effects  of  supply  of  resources  and  situation  parameters  on  performance,  and  to 
conjecture  about  the  way  by  which  al location  policy  depends  on  the  value  of  outcomes 
of  different  allocations.  Finally,  relevant  empirical  evidence  and  implications 
for  further  research  are  discuused. 

W/i.  Cat.  Code:  3.3 

Op.  Behav.  Code:  2.0 

Primary  task  Math. model  Construct  None  Flight  simulator 

Flight  test 


Navon,  D.  and  Gopher,  D.  Task  difficulty  resources  and  dual  task  performance. 
Attention  and  Performance  VIII.  Hillsdale,  New  Jersey:  Lawrence  Erlbaum 
and  Assoc. ,  1979.  (In  press.) 

If  the  processing  system  Is  viewed  as  comprised  of  a  number  of  mechanisms  each 
having  its  own  capacity,  which  may  be  considered  as  a  separate  resource,  then 
a  difficulty  manipulation  may  affect  differentially  the  use  of  each  of  those 
capacities.  If  in  a  dual- task,  situation  a  manipulat  ion  of  the  difficulty  of 
one  task  affects  the  use  of  a  mechanism  which  is  not  required  by  the  other  task, 
processing  of  the  latter  may  remain  intact  under  come  circumstances.  To  git  a 
complete  picture  of  how  difficulty  affects  dual-task  performance,  it  is  proposed 
to  manipulate  tusk  preferences  as  well  as  difficulty  parameters  and  to  present 
their  joint  effect  i>y  families  of  POCs.  An  application  of  this  methodology  to 
the  study  of  pursuit  tracking  i.s  briefly  described  and  interpreted  in  terms  of 
multiple  resources. 

W/L  Cat.  Code:  2.2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  iaak  Construct  laboratory  Background 

Primary  task  Single  measures  Experimental 
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SY-27R-80 


Nagoascu,  R.  Validity  and  limitations  of  telametric  evaluations  of  mental 
load.  Paper  presented  r. t  the  7t.h  Congress  of  the  International  Prsunottica 
A»?cci?tion,  Warsaw,  Inland,  August  27-31,  1979. 

This  pa^er  is  a  parser *1  viaw  of  the  current  status  cf  telemetric  measurement 
of  electrophysiologic* 1  parameters  for  tho  ergonomic  assessment  of  perceptual 
and. mental  strain.  Defining  the  optimum  set  if  parameters  may  allow  one  to 
establish  the  relative  importance  of  alternative  telemetric  methods  for  n  >me  of 
the  more  important  models  of  informational  workload.  To  this  end  we  investigated 
physiological  responses  in  an  experimental  simulation  of :  (a)  up tiro; an  informational 

load;  and  (b)  sub-optimum  load  (monotony).  Arguments  are  advanced  for  the  prime 
Importance  of  heart  rets  and  heart  rate  variability  in  optimum  load  measurement, 
as  well  as  for  the  usefulr.eat  of  plethysmography  and  eleclroc  uephalography  in 
studies  of  monotonous  work. 

W/L  Cat.  Code:  4.1.3,  4.1.5,  4.1.10 

Op.  Behav,  Code:  1.,  2. 

Physiological  ZKG  Experimental  Laboratory  Background 

EEC 

Heart  rate, 
h.r.  var. 


Nicholson,  A.  N.  Aircrew  workload  duiicrt  the  approach  and  landing. 

Aeronautical  Journal,  1973,  77,»  286-' 39. 

The  workload  duritt  the  approach  and  landing  which  is  likely  to  be 
experienced  by  any  airline  pilot  operating  worldwide  routes  is  analyzed. 

The  operational  procedures  of  the  flight  deck  involved  in  the  study 
conform  to  those  used  by  the  majority  of  international  carriers.  The 
workload  during  each  letdown  was  assessed  by  the  pilot.  The  individual 
factors  which  influenced  the  workload  assessment  were  the  technical 
serviceability  of  the  aircraft  and  efficiency  of  the  control  procedures. 

It  appears  that  factors  amenable  to  correction  tire  likely  to  be  responsible 
for  much  of  the  high  workload  situations  in  civil  transport  operations. 

W/L  Cat.  Code:  1.2,  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.4. 

Opinion  Questionnaire  Experimental  Flight  test  Flight  simulator 

Spare  m.  capacity  Task  comp..  Flight  test 

time  aseera. 
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A.. 


SY-27R-80 


Nicholson,  A.  N.,  Hill,  L.  E, ,  Borland,  R.  G. ,  and  Krzanowski,  W.  J. 

Influence  cf  workload  on  the  neurological  state  of  a  pilot  during  the 
approach  ana  landing.  Aerospace  Medicine,  1973,  44,  146-152. 

The  workload  of  a  pilot  during  the  let  down  of  a  Boeing  707  was  modified  by 
coupling  the  aircraft  to  the  ILS  localizer  and  glide  slope  path  (coupled 
approach)  or  by  increasing  the  participation  of  the  co-pilot  in  the  handling 
of  the  aircraft  (shared  approach).  The  electrocardiogram  of  the  pilot  was 
recorded  during  the  let  down  and  finger  tremor  was  recorded  after  landing. 

The  operational  significance  of  these  studies  is  discussed. 

w/'L  Cat.  Code:  4.1.3,  4.1.9 

Op.  2shav.  Code:  1.,  2.,  4. 

Physiological  EFG  Experimental  Flight  test  Flight  simulator 

Muscle  tension.  Flight  test 

tremor 


Noble,  M.  and  Trumbo,  D.  The  organization  of  skilled  response.  Organizational 
Behavior  and  Human  Performance,  1967,  2,  1-25. 

A  series  of  experiments  concerned  with  the  ways  in  which  responses  become 
organized  is  discussed.  The  principle  parameter  in  most  studies  was 
stimulus  coherence,  and  tracking  tasks  were  used  as  a  vehicle  because 
graded  responses  permit  detailed  and  fine-grained  analyses.  Both  spatial 
and  temporal  coherence  are  used  in  response  organization,  and  type  of 
response  strategy  varys  with  degree  of  stimulus  coherence.  The  effects 
of  secondary  tasks,  sequence  length  and  task  ceding  were  also  examined. 

W/L  Cat .  Code:  2.2 

Op.  Bebav.  Code:  i. ,  2.,  4. 

Spare  m.  capacity  Subsidiary  tack  Experimental  Laboratory  Background 
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*asa 


SY-27R-80 


Noel,  C.  E.  Pupil  diameter  versus  task  layout.  Master's  thesis,  Naval 

Postgraduate  School,  Monterey,  California,  Saptember,  1974.  (AD  787  375). 

Using  pupil  size  as  an  indirect  measure  of  mental  activity,  this  experiment 
Investigated  a  spatially  compatible  and  non- compatible  forced  choice  task. 

It  was  found  subjects  could  process  a  higher  presentation  rate  in  the  compatible 
layout  than  in  the  non-compatible  layout  without  going  into  an  overload 
condition.  Also,  when  subjects  vere  already  in  a  pupil  constricted  condition 
(overloaded)  in  a  non-compatible  arrangement,  it  was  found  the  constriction 
could  be  significantly  reduced  by  switching  to  a  compatible  arrangement. 

W/L  Cat.  Code:  4.1.8,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Pupillary  dia.  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures 


Norman,  D.  A.  and  Babrow,  D.  G.  On  data-limited  and  resource  limited  processes. 

Cognitive  Psychology,  1975,  _7>  44-64. 

This  paper  analyzes  the  effect  on  performance  when  several  active  processes 
compete  for  limited  processing  resources.  The  principles  discussed  show  than 
conclusions  about  the  interactions  among  psychological  processes  must  be  made 
with  caution,  and  some  existing  assumptions  may  be  unwarranted.  When  two  (or 
more)  processes  use  the  seme  resources  at  the  same  time,  they  may  both  interfere 
with  one  another,  neither  may  interfere  with  the  other,  or  one  may  interfere  with 
a  second  without  any  interference  from  the  second  process  to  the  first.  The 
important  principles  are  that  a  process  can  be  limited  in  tis  performance  either 
by  limits  in  the  amount  of  available  processing  resources  (such  as  memory  or 
processing  effort)  or  by  limits  in  the  quality  of  the  data  available  to  it. 
Competition  among  processes  can  affect  a  resource-limited  process,  but  not  a 
data-limited  one.  A  number  of  experiments  from  the  psychological  literature 
are  examined  according  to  these  processing  principles,  resulting  in  some  .  w 
interpretations  of  interactions  among  competing  psychological  procepses. 


W/L  Cat.  Code:  2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Spare  m.  capacity  Subsidiary  task  Review 


Primary  task 


Single  measures  Construct 


Laboratory  Background 
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i.O.: 


SY-27R-80 


North,  R.A.  Task  components  and  demands  as  factors  in  dual-task  performuacn. 

Savoy,  Illinois:  University  of  Illinois  at  Urbane-Champaign,  ARL-77-2/ 

AFOSR-77-2,  January,  1977. 

Tills  study  explored  the  effects  of  interference  between  tasks  as  related  to 
their  specific  functional  requirements  and  under  changing  priorities.  Four 
tasks  were  performed  singly  and  in  all  pairwise  combinations  to  compare  their 
mutual  interference  levels.  The  tasks  were  one-dimensional  compensatory 
tracking,  and  three  self-paced  keyboard  response  tasks,  one  requiring  a 
transformation  by  categorizing,  one  requiring  storing  and  responding  with  the 
previous  stimulus,  and  one  requiring  no  intervening  activity  between  stimulus 
recognition  and  response.  Tracking  paired  with  any  of  the  three  keyboard  tasks 
was  least  interfering,  tracking  and  tracking  was  moderately  interfering,  and 
keyboard/keyboard  combinations  the  most  interfering,  suggesting  that  qualitatively 
dissimilar  tasks  are  performed  better  than  functionally  similar  tasks.  The 
keyboard  task  requiring  continuous  storing  and  response  tc  the  previous  stimulus 
was  highly  disruptive  when  paired  with  other  keyboard  tr.sks,  end  showed  little 
evidence  of  interweaving  with  them  while  the  transformation  keyboard  task  van 
not  as  disruptive  and  could  be  interweaved  with  itself  or  the  simple  keyboard 
task.  The  manipulation  of  dual- task  demands  produced  expected  changes  Jsi 
performance  in  nearly  all  task  combi rations ,  but  was  strongest  in  tracking /tracking 
end  certain  keyboard /keyboard  comb inat ions. 

W/L  Cat.  Code:  2.2,1,  2.2.2 

Op.  Behav.  Code:  1.1,  2.1,  4.2 

Spare  m.  capacity  Subsidiary  cask  Experimental  Laboratory  Flight  simulator 


North,  R.  A.  and  Gopher,  D.  Measures  of  attention  as  predictors  of  flight 
performance.  Human  Factors,  1976,  18i,  1-14. 

A  new  technique  for  measuring  individual  differences  in  basic  attention 
capabilities  and  the  validity  of  these  differences  in  predicting  success  in 
flight  training  were  investigated.  The  testing  system  included  e  digit¬ 
processing,  reaction-time  task  and  e  one-dimensional  compensatory  tracking 
task.  Comparisons  were  made  between  separate  and  concurrent  performances 
of  these  tasks,  with  both  equal  and  shifting  task  priorities.  Adaptive 
techniques  were  employed  to  obtain  maximum  performance  levels  for  each 
subject  in  the  single-task  condition  and  to  maintain  dual-task  difficulty 
within  subjects.  Consistent  individual  differences  in  basic  attention 
capabilities  were  observed  and  several  dimensions  of  attention  capabilities 
are  suggested.  A  preliminary  validation  study  compared  scores  for  flight 
instructors  and  student  pilots.  In  addition,  the  student  staple  was 
dichotomized  based  on  performance  in  training.  There  were  reliable 
differences  for  both  groups  on  dual-task  performance  efficiency. 

W/L  Cat.  Code:  2.2.1,  2.2,2r  3.1 

Op.  Behav.  Code:  2.1,  4.2 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  maanjres 
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..-ifiktrtty** 


SY-J7R-80 


Kuf«;br  r,v  and  Gr*f£undur0  K.  Evaluation  of  :%  pilot  workload  metric  for 
simulated  TfOL  landing  tanke.  Proceedings  of  the  2 3rd  Annual  Meeting  of 
the  ftwr.  Factors  Society,  Boston,  Massachusetts,  October  29-tlov-enoer  1, 

I3?9~ "357-361. 

I  ■  , 

A  nwithodologicrj.  approach  to  measuring  workload  was  investigated  for  evaluation 
of  new  concepts  in  VTOL  aircraft  displays.  Multivariate  discriminant  functions 
were  formed  from  conventional  flight  performance  and/or  visual  response  variables 
to  maximise  detketior,  of  experiments!  differences.  The  flight  performance  variable 
discriminant  showed  maximum  differentiation  between  crosswin  1  conditions.  The 
visual  response  measure  discriminant  maximized  differences  between  fixed  vs.  motion 
base  conditions  and  experimental  displays.  Physiological,  variables  were  used 
to  attempt  to  predict  the  discriminant  function  values  for  each  nubjact/conditor./ 
trial.  The  weights  of  the  physiological  variables  in  these  equations  showed 
agreement  with  previous  studies.  High  muscle  tension,  1# jhc  but  Irregular 
breathing  patterns,  and  higher  heart  rate  with  low  amplitude  all  produced  higher 
scores  on  this  scale  and  thuo,  represented  higher  scores  on  thle  scale  and  thus, 
represented  higher  workload  levels. 

W/L  Cat.  Code: 

Pp.  Behav.  Code: 

Opinion 
Primary  task 
Physiological 


1.1,  3.2,  4.1.3,  4.1.4,  4.1,7,  4.1.8,  4.J.9,  4.1.10,  4.1.14,  4.2 
1.,  2.,  4. 

Multiple  Experimental  Flight  simulator  Flight  simulator 

Flight  teat 


Noyer,  A.  Mental  fatigue  and  palmar  skin  resi8tai.ee.  Travail  riumain,  1971, 

34,  289-298.  (In  French). 

The  palmar  skin  resistance  was  measured  in  eleven  subjects  during  &  prolonged 
peric-i  of  mental  overload  (experiment  1) ,  and  then  during  a  period  of  partial 
mental  rest  (experiment  i.l) .  The  mean  palmar  skin  resistance  at  the  end  of 
experiment  1  was  lower  than  at  the  end  of  experiment  ii.  This  difference  was 
found  in  the  majority  of  subjects — the  significance  being  shown  best  in  subjects 
where  the  initial  levels  were  similar  for  both  experiments.  The  palmar 
resistance  thus  seems  able  to  discriminate  two  mental  activities  of  differing 
intensities.  It  is  suggested  that  this  method  be  used  in  the  recognition  of 
mental  fatigue.  The  phenomenon  of  the  individuality  of  the  responses  could 
be  confirmed. 

W/L  Cat.  Code:  4.1.2 


Op.  Behav.  Code:  2.1 

Physiological  GSR  Experimental  Laboratory  Flight  simulator 
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Och,  G.  line  budget  ta  a  criterion  for  the  workload  of  .iir  traffic  controller. 
Munich,  West  Germany:  Meseerschmidt-Boelkov  G.m.b.H. 

A  tint;  optimization  method  for  evaluating  the  capacity  of  air  traffic  controllers 
is  presented.  Aa  within  a  given  time  interval,  only  a  limited  number  of  minutes 
can  be  used  for  active  control,  the  time  consumption  for  the  control  of  various 
flight  phaseu  was  measured  and  used  to  calculate  the  number  of  flights  which  could 
be  controlled  during  this  interval.  X  capacity  profile  for  the  entire  air  space 
of  the  Federal  Rep-iblic  of  Germany  was  constituted  fron.  characteristic  traffic 
patterns  obtained  for  each  control  sector. 

W/L  Cat.  Code: 

Of.  3ete\ .  Code: 

Spare  m.  capacity 

Primary  task 


2.1.1,  3.1 
1.,  2.,  3.,  4. 

Task  comp..  Construct  Field  Flight  simulator 

time  assess. 

Single  measures  Experimental 


O'Connor,  tf.  F.  and  Buede,  B.  M.  The  application  of  decision  analytic  techniques 
to  th-s  test  and  evaluation  phase  of  the  acquisition  of  a  major  air  system. 
McLean,  Virginia:  decisions  and  Designs,  Technical  Report  77-3,  April,  1977. 

The  purpose  of  this  effort  has  been  to  explore  the  feasibility  of  applying 
decision  analytic  techniques  to  the  test  and  evaluation  phase  of  the  acquisition 
of  a  major  weapons  system.  The  proposed  response  to  this  need  is  a  computerized 
system,  Implemented  on  an  IBM  5100  which  contains  the  test  and  evaluation 
information  appropriately  prioritised.  'Co  achieve  this  goal,  two  main  tasks 
must  be  accomplished.  One  is  the  development  of  a  hierarchical  evaluation 
structure  which  relates  all  the  test  and  evaluation  information  to  missions  of 
the  F18.  An  initial  structure  has  been  developed  for  the.  controller  of  aircraft 
role  for  the  fighter  version  of  the  FIS,  and  this  structure  hrs  bean  implemented 
on  the  £BM  5100  portable  computer.,  To  use  such  a  structure,  it  is 
necessary  to  develop  a  meaningful  ratinp  scale  ou  which  to  rate  the  aircraft 
with  respect  to  thesa  tasks.  Two  major  considerations  are  in’rolved — pilot 
workload  and  system  effectiveness. 

W/L  Cat.  Code:  1.1 

Op.  Behav.  Code:  2.1,  2.3 

Opinion  Rating  scale  Construct  Laboratory  Flight  simulator 


SY-27R-80 


O'Donnell,,  R.  D.  Secondary  Cask  assessment  of  cognitive  workload  in  alternative 
cockpit  configurations.  Wright-Pat terson  AFB,  Ohio:  Aerospace  Medical 
Research  laboratory,  AMRL-TR- 75-49,  1975.  (AGARD-CPP-181) . 

New  developments  in  cockpit  design  may  introduce  significantly  greater  cognitive 
demand  on  the  crew  member.  Yet  few  measurement  techniques  exist  which  are  able 
to  provide  an  objective,  reliable  estimate  of  the  workload  Introduced  by  these 
new  systems.  New  approaches  are  therefore  required.  In  a  series  of  pilot 
studies,  traditional  secondary-task  reserve  capacity  concepts  were  modified  to 
be  used  at  sub-maximal  levels  of  workload.  A  primary  flight  simulation  was 
performed  simultaneously  with  the  item  recognition  task  proposed  by  Sternberg. 

This  task  was  chosen  because  the  intercept  and  slope  functions  of  the  memory- 
load/reaction  time  function  appear  to  assess  Independently  cognitive  and  sensory- 
motor  workload.  Results  indicated  the  secondary  task  shows  reliable  and  consistent 
changes  with  variations  in  workload,  and  appears  promising  as  an  objective  measure 
of  higher  mental  functions.  Auditory  and  visual  versions  have  been  constructed, 
and  further  validation  studies  are  being  carried  out. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  fiehav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  measures  Flight  test 


O'Donnell,  R.  D.  Secondary  task  assessment  of  cognitive  workload  in  alternative 
cockpit  configurations.  In  B.O.  Hartman  (Ed.)  Higher  Mental  Functioning -in 
Operational  Environments,  AGARD  Conference  Proceedings  No.  181,  April,  1976, 

C-10.  (AD  A025  663). 

New  developments  in  cockpit  design  may  introduce  significantly  greater  cognitive 
demand  on  the  crew  member.  Yet  few  measurement  techniques  exist  which  are  able 
to  provide  an  objective,  reliable  estimate  of  the  workload  introduced  by  these 
new  systems.  New  approaches  are  therefore  required.  In  a  series  of  pilot  studies, 
traditional  secondary-task  reserve  capacity  concepts  were  modified  to  be  used  at 
sub-maximal  levels  of  workload.  A  primary  flight  simulation  was  performed 
simultaneously  with  the  item  recognition  task  proposed  by  Sternberg.  This  task 
was  chosen  because  the  intercept  and  slope  functions  of  the  memory-load/reaction 
time  function  appear  tc  assess  independently  cognitive  and  sensory-motor  workload. 
Results  indicated  the  secondary  task  shows  reliable  and  consistent  changes  with 
variations  in  workload,  and  appears  promising  as  an  objective  measure  of  higher 
mental  functions.  Auditory  and  visual  versions  have  been  constructed,  and  further 
validation  studies  are  being  carried  out. 

W/L  Cat,  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  flight  simulator 
Primary  task  Single  measures  Flight  test 
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O'Donnell,  R.D.  end  Spicuzza,  R.J.  Pilot  pet  Romance  assessment  in  systems  using 
Integrated  digital  avionlce.  Proceedings  of  the  46th  Annual  Meeting  of  the 
Aerospace  Medical  Association,  San  Francisco,  California,  1975. 

An  attempt  has  been  made  to  develop  new  methodological  approaches  to  the  assess¬ 
ment  of  skills  which  will  be  required  in  advanced  systems.  The  overall  approach 
Involved  development  of  secondary  tasks  which  the  operator  was  required  to 
perform  along  with  a  primary  flying  task.  Well  established  psychomotor  tasks, 
and  tests  ol  cognitive  function  which  have  been  used  in  non-applied  settings, 
were  explored  for  their  potential  value  as  components  of  an  overall  secondary 
task  battery.  The  simulator  chosen  for  the  early  phases  of  this  program  was  driven 
by  the  Human  Engineering  Systems  Simulator  (IBM  360-40)  and  used  some  of  the 
dynamics  of  the  lightweight  fighter  aircraft.  The  subject  was  instructed  to  fly 
a  particular  mission  segment  lasting  from  one  to  five  minutes.  During  that  time 
he  was  also  required  to  perform  one  of  four  secondary  tasks.  The  computer  sur¬ 
veyed  the  status  of  all  systems  and  determined  the  degree  of  error  from  required 
flight  parameters.  These  deviations  were  integrated  in  a  weighted  formula  to 
arrive  at  a  single  score  which  sunmarized  the  subject's  ability  to  fly  that  mission 
for  a  particular  amount  of  time  with  a  particular  secondary  task.  This  evaluation, 
combined  with  manipulation  of  the  actual  workload,  provided  a  stable  base  for 
evaluating  the  meaning  of  changes  in  secondary  tasks  during  performance  of 
particular  primary  tasks. 

W/L  Cat.  Code:  2.2.1,  2.2.2,  3.2 


Op  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  Flight  simulator  Flight  simulator 

Primary  tssk  Mult,  ms  as  liras  Expsriasntsl  Flight  tsst 


Offenloch,  K.  Neurophysiological  assessment  of  functional  states  of  the 

brain.  Proceedings  of  the  ACARD  Conference  on  Methods  to  Assess  Workload, 
AGARD- CP-216,  April,  1977,  A10-1  -  A10-4. 

Neurophysiological  methods  are  used  to  assess  functional  states  of  the  brain 
with  precision  that  surpasses  that  of  classical  psychological  methods.  Not  only 
neurological  syndromes,  but  also  slight  changes  on  the  vigilance  scale  as  well  as 
functional  changes  associated  with  cognitive  and  intellectual  functions  can  be 
correlated  with  the  electrical  activity  of  the  brain  ana  hereby  be  objectively 
determined. 

W/L  Cat.  Code:  3.1,  4.1.5 

Op,  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Construct  Laboratory  Background 

Physiological  EEG  Experimental 


SY-27R-80 


Og  ea,  G.  D. ,  Levine,  J.  M.,  end  Eisner,  E.  J.  Measurement  of  workload  by' 
secondary  tasks.  Human  Factors,  1979,  21,  529-5A8. 

The  post-1965  literature  on  the  use  of  secondary  tasks  in  the  assessment  of 
operator  workload  was  surveyed.  Twelve  classes  of  tasks  were  Identified;  the 
most  frequently  used  were  choice  reaction  time,  memory,  monitoring,  and  tracking. 
The  literature  review  did  not  suggest  a  single  beet  task  or  class  of  tasks  ‘'or  *-he 
measurement  of  workload.  Limitations  in  using  secondary  tasks  are  discussed, 
and  directions  for  future  research  are  presented. 

W/L  Cat.  Code:  2.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  None  Flight  simulator 

Flight  test 


Ohhara,  S.  Changes  of  tracking  performance,  respiration,  and  heart  rate 
duri"'  experimentally  induced  anxiety.  Japan  Air  Self  Defense  Force, 

Acre  .deal  Laboratory  Reports,  1970,  1JL,  198-205.  (in  .Yr.panese) . 

Changes  caused  by  unexpected  noise  stress  and  anticipated  pnychic  stress  on 
tra<*'  performance,  respiration  and  heart  rate  were  investigated.  The  main 
rest,  obtained  are:  (1)  in  general,  unexpected  noise  stress  affected  per¬ 
former  i  more  strongly  than  anticipated  psychic  stress;  (2)  it  took  1  sec  to 
re cove  rom  the  increased  heart  rate  caused  by  unexpected  stimulation;  (3) 

tracking  performance  was  arrested  after  0. A  to  0.8  sec  following  stimulation; 
and  (A)  it  took  0,8  to  2. A  sec  to  recover  from  this  block. 


W/L  Cat.  tjde:  A. 1.10,  4.1.11 

Op  Behav.  ..ode:  1.,  2.,  3.,  A. 


Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 

Fhysiological  Heart  rate,  Flight  test 

h.r.  var. 

Breathing  anal. 
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SY-27R-80 


Oldtr,  H-  J.  and  denuey,  L.  L.  Psychological  it res?  measurement  through  voice 
output  analysis.  Alexandria,  Virginia:  The.  Planar  Corporation,  Oov?tract 
NAS  9-14146,  March,  1»?5. 

Audio  tape  recordings  of  selected  Skylab  communications  were  processed  by  the 
Psychological  Stress  Evaluator  (PSE)  manufactured  by  Dekr.oi  Counterintelligence 
and  Security,  Inc.,  Springfield,  Virginia.  Strip-chart  tracings  were  read 
"blind*"  and  scores  were  assigned  based  m  characteristics  reported  by  the 
manufacturer  to  Indicate  psychological  stress.  These  scores  were  analyzed  for 
their  empirical  relationships  with  operational  variables  in  Skylab  judged  to 
represent  varying  degrees  of  situational  straps.  Although  some  statistically 
significant  relationships  were  found,  the  technique  was  not  judged  to  bo 
sufficiently  predictive  to  warrant  its  use  in  assessing  the  degree  of 
psychological  stress  of  crew  members  In  future  space  missions. 

W/L  Cat.  Code:  3.1,  4.3 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Single  measures  Experimental  Flight  test  Flight  simuiato- 

Physiological  Speech  patt.  Flight  test 

anal. 


Olson,  B.  A.  Display  and  control  requirements  study  for  a  V/STUL  tactical 
aircraft.  Wright-Pat terson  AFB,  Ohio:  USAF  Flight  Dynamics  Laboratory, 
AFFDL-TR-66-114 ,  December,  1966. 

A  study  of  the  displuy/control  requirements  for  a  tactical  V/STOI,  aircraft 
was  conducted  uaing  analytical  and  simulation  techniques.  Workload  levels 
were  calculated  by  the  discontinuous  control  analysis  technique  for  the 
V/STOL  crews  discrete  tasks.  Pilot  workload  levels  were  empirically 
established  for  level  aerodynamic  flight,  transition  to  hover,  arid  landing 
from  hover.  Three  landing  display  formats,  two  manual  control  modes,  three 
thrust-to-weight  ratios  and  three  wind  conditions  were  evaluated.  A  landing 
display  format  was  developed  that  was  demonstrated  to  be  feasible  for 
operating  a  V/STOL  IFP.  with  minimum  electronic  aids  on  the  ground  and  at 
less  than  100  percent  pilot  workload. 

W/L  Cat.  Code:  2.1.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Inform,  theory  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  measures  Flight  test 
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SY-27R-80 


Qnstott,  E.  D.  Task  Interference  In  mrlti-axis  aircraft  stabilization 

Proceedings  of  the  12th  Annual  KASA-Univcrsity  Conference  on  Manual  Control . 
University  of  Illinois,  May,  1976,  80-103.  (3ASA  TM  X-73,170). 

A  time  domain  attention  allocating  multi-axis  pilot  model  has  been  used  to 
examine  task  interference  effects  In  a  two-axis  attitude  stabilization  task 
in  turbulence.  Configurations  from  a  matrix  of  uncoupled  lateral  and 
longitudinal  F-5  dynamics  were  analyzed  to  determine  the  influence  of  each 
axis  on  the  control  performance  of  the  other.  The  analysis  showed  that  an 
inappropriate  choice  of  longitudinal  dynamics  would  deteriorate  the  roll 
stabilization  with  no  change  in  the  lateral  dynamics  or  pilot  model.  Further¬ 
more,  the  Influence  of  roll  versus  pitch  angle  display  scalings  were  analyzed 
by  hypothesizing  that  the  task  urgencies  used  to  allocate  attention  in  the 
pilot  model  should  je  weighted  by  the  scaling  factors.  A  fixed  base  simulation 
verified  the  model,  the  resonant  task  interference,  and  the  scaling  hypothesis; 
further  validation  through  manned  simulation  was  performed  uainy  a  complete 
nonlinear  YF-17  aircraft  model  and  the  Northrop  Large  Amplitude  Simulator. 

W/L  Cat.  Code:  3.1,  3.3 

Op.  Behav.  Code:  l.,  2.,  4, 

Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 
Hath,  model  Flight  test 


Onstott,  E.  D.  and  Faulkner,  w.  H  Prediction  of  pilot  reserve  attention  capacity 
during  air-to-air  target  tracking.  Proceedings  of  the  13th  Annual  NASA- 
University  Conference  on  Manual  Control,  Massachusetts  Institute  of  Technology, 
June,  1977,  13G-142. 

Rest  rve  attention  capacity  of  a  pilot  has  been  calculated  using  the  Northrop  pilot 
model  that  allocates  exclusive  model  attention  according  to  the  ranking  of  tnak 
urgency  functions  whose  variables  are  tracking  error  and  error  rate.  The  modeled 
task  consisted  of  tracking  a  maneuvering  target  aircraft  both  vertically  and 
horizontally,  and  when  possible,  performing  a  diverting  side  task  which  was  simulated 
by  the  precise  positioning  of  an  electrical  stylus  and  modeled  as  a  task  of  constant 
urgency  in  the  attention  allocation  algorithm.  The  urgency  of  the  single  loop 
vertical  task  is  simply  the  magnitude  of  the  vertical  tracking  error,  while  the 
multiloop  horizontal  task  requires  a  nonlinear  urgency  measure  of  error  and  error 
rate  terms.  Comparison  of  model  results  wirn  flight  simulation  data  verified  the 
computed  model  statistics  of  tracking  err jt  of  both  axes,  lateral  and  longitudinal 
stick  amplitude  and  rate,  and  side  task  episodes.  Full  dat.\  for  the  simulation 
Cracking  statistics  as  well  as  the  explicit  equations  and  structure  of  the  urgency 
function  multi-axis  pilot  model  are  presented. 

W/L  Cat.  Code:  2.2.1,  2.2.2,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  Flight  simulator  Flignt  simulator 
Primary  task  Math,  models  Experimental  Flight  test 
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SY-27R-80 


Opmecr,  C.  H.  J.  M,  and  Xroi,  J.  P.  Towards  an  objective  assessment  of  cockpit 
workload.  I -physiological  variables  during  different  flight  phases. 

Aerospace  Medicine,  1973,  44,  527-532. 

Experiments  in  a  DC-7  simulator  and  an  AT-100  (Beachcraft)  simulator,  in  which 
an  attempt  was  made  to  validate  heart  rate  (HR),  heart  rate  irregularity  (HI), 
and  respiratory  rate  (RE.)  as  indicators  of  mental  load  are  described.  As  a 
criterion  the  following  scale  was  used,  from  least  to  most  difficult  task:  rest; 
level  flight;  take  off;  approach.  The  overall  difierenees  proved  to  be 
significant  at  the  0.1%  level.  The  changes  in  physiological  variables  from  phase 
to  phase  showed  a  correlation  of  0.80  with  the  predicted  direction.  The  highest 
discriminating  power  according  to  the  omega  squared  criterion  was  shown  by  RR, 
followed  by  HI  and  HR,  in  this  order.  During  an  experiment  with  parachute 
jumpers,  in  which  an  anxiety  scale  was  used  as  a  criterion,  the  reverse  order 
was  fouud . 

W/L  Cat.  Code:  1.1,  4.1.10,  4.1.11 

Op.  Behav.  Cede:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Physiological  Heart  rate,  Field  Flight  test 

h.r,  var. 

Breathing  anal. 


Opraeer,  C.  H.  J.  M.  The  information  content  of  successive  RR- interval  times 

in  the  EC” .  Preliminary  results  using  factor  analysis  and  frequency  analysis. 
Ergonomics ,  1973,  lf>,  105-112. 

Factor  analyt  is  v..d  frequency  analysis  were  applied  to  seriea  of  Interval  times 
between  successive  heart  beats  in  a  preliminary  effort  to  get  a  raaxlmal  amount  of 
information  from  this  kind  of  data.  I'.rom  a  sample,  with  t  mean  heart  rote 
ranging  from  56*2  to  156*4  per  minute,  ?5  values  (partly  by  using  thresholds) 

,*ere  derived  and  intercorrelated.  Scores  based  on  the  summation  of  successive 
differences  and  standard-deviation  scores  showed  a  mean  correlation  of  096  and 
were  called  together  a  Decomplex.  I actor  analysis  revealed  4  interpretable 
factors,  explaining  H3%  of  the.  toial  variance.  Frequency  analysis  results  were 
iutercorrelated  with  all  other  val.uos  and  showed  a  high  correlation  with  the 
D  coaplcx.  The  use  of  "scoring'  verauc  "measuring'’  is  discussed. 

V/L  Cat.  Code:  4.1.3,  4,1.10 

OP.  Behav.  Code:  1.,  ?.,  4. 

Physiological  EKG  Corstruct  Laboratory  Background 

Heart  rate,  Experimental  Field 

h.r.  var- 
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SY-27R-80 


Owens,  J.  M.  and  Harris,  S.  D.  On  tha  assessment  of  processing  demands  in  complex 
task  structure*.  Pensacola,  Florida:  Naval  Aerospace  Medical  Research 
Laboratory,  NAMRL-1249,  July,  1978.  (AD  A060  317). 


The  ganaral  applicability  of  secondary  task  techniques  for  assessing  processing 
demands  in  noncomplex  task  situations  has  not  been  established.  Therefore,  an 
Investigation  involving  such  tasks  was  undertaken.  A  primary  task  involving 
successive  processing  operations  upon  information  Including  1)  encoding,  2) 
rehearsal,  3)  transformation,  and  4)  comparison-decision  was  performed  simultaneously 
with  secondary  probe  tasks  requiring  simple  reaction  time  (RT)  or  choice  reaction 
time  (RT)  responses.  Simple  RT  responses  were  performed  significantly  faster  than 
choice  RT  responses  in  lha  secondary  task.  The  Increase  In  reaction  time  for  choice 
RT  responses  suggested  that  subjects  used  serial  processing  strategies  to  avoid 
capacity  overload.  Secondary  task  error  rates  increased  during  the  comparison- 
decision  interval  of  the  primary  task,  and  primary  task  reaction  times  Increased 
when  probe3  occurred  during  the  transformation  and  comparison-deciaion  Intervals. 
These  findings  suggest  that  problema  associated  with  controlling  the  allocation  of 
processing  resources  to  varying  combined- task  demands  may  depreciate  the  utility 
of  secondary  task  techniques  In  complex  task  situations. 

W/L  Cat.  Code:  2.2.1 .  3.1 

Op.  Behev.  Code:  1.,  2.,  4.1 


Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Pardon,  N.  Methods  of  evaluation  of  mental  load.  Cahiers  de  Medicine 
Interpvofeaaionnelle,  1977,  No.  65,  19-38.  (In  French 

General  remarks  are  presented  on  work  load  (different  points  of  view  of  the  work 
organizer  and  the  ergonomist)  and  mental  load  (qualitative  and  quantative 
assessment),  subjective  experience  of  mental  load  (individual  and  collective 
reactions,  fatigue).  The  article  is  mainly  devoted  to  a  review  of  objective 
evaluation  criteria  (work  studies  especially  on  the  basis  of  the  bit  as  unit  of 
information,  study  of  the  operator' c  attitude  in  mental  work  situation;  productivity 
studies).  The  part  played  by  environmental  factors,  trends  in  the  mertal  load  and 
ageing  is  also  assessed.  An  example  of  a  questionnaire  design  is  presented. 


W/L  Cat.  Code: 

1.2,  3.1 

Op.  Behav.  Code: 

1. ,  2 . ,  3. ,  4. 

Opinion 

Questionnaire  Review 

None 

Primary  task 

Single  measures  Construct 

Background 
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Parka ,  D.  L.  Current  workload  methods  and  emerging  challenges.  In  N.  Moray 
(Sd.)  Mental  workload:  Its  theory  and  measurement.  New  York:  Plenum  Press, 
1979,  387-416. 

This  paper  summarises  selected  technology  methods  and  needs  In  system  design. 

Three  major  subject  areas  are  discussed:  (1)  Background  on  methods  evolution 
and  effectiveness  Is  summarised  to  Illustrate  methode  and  needs.  (2)  The 
applied  environment  and  Its  demands  are  described,  including  the  system 
development  procese  with  activities,  man-machine  interface  trade-offs,  a 
workload  method  that  la  used,  end  questions  the  analyst  must  resolve  on  a 
timely  basis.  More  extensive  information  on  a  working  approach  is  presented  - 
including  the  needs,  soma  of  the  methods,  and  some  of  the  constraints  for 
presently  developing  electronic  systems.  (3)  Near  tarm  technology  challenges 
are  Identified  for  developing  computerised,  electronic  display  and  control  systems. 
This  latter  section  emphasises  concern  with  increasing  utility  of  analytic 
medals  to  develop  or  evaluate  a  proliferation  of  highly  flexible  display- 
control-inrormation  processing  systems.  Overall,  selected  design  methods 
and  questions  are  presented  as  a  framework  to  which  theorists  might  relate 
their  currant  state-of-art  and  provide  techniques  for  present  design  use. 


W/L  Cat.  Code: 


2.1.1 


Op.  Behav.  Coda:  1. ,  4. 


Spare  m.  capacity  Task  comp.  Construct  None  Flight  simulator 

task  assess. 


Flight  test 


Parks,  D.  L.  and  Springer,  W.  E.  Human  factors  engineering  analytic  process 
definition  and  criterion  development  for  Computer  Aided  Function- allocation 
Evaluation  System  (CAFES).  Seattle,  Washington:  Boeing  Aerospace  Company, 
D180-18750-1,  January,  1976.  (AD  A040  473). 

This  report  presents  results  of  a  study  to:  (1)  develop  descriptive  Information 
for  the  Human  Factors  Engineering  process  in  system  development;  (2)  evaluate 
the  Computar  Aided  Function -A] location  Evaluation  System  (CAFES)  for  ability 
to  support  the  process  and  for  desirable  refinements;  and  (3)  define  task  and 
equipment  data  requirements  for  CAFES.  In  the  resulting  single  thread 
description  of  an  approach  to  performing  HFE  activities,  requirements, 
methodology  and  examples  of  a  manual  approach  are  presented.  These  are 
followed  by  brief  descriptions  of  CAFES  models  and  their  capability  to  support 
the  process.  Candidate  concepts  for  further  refinement  and  application  of 
CAFES  are  Included. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Spare  m.  capacity  Task  comp. , 

time  assess. 


Construct  Laboratory  Flight  simulator 
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Pasmooij,  C.  K.  Workload  of  the  radar-air  traffic  controllara  at  Schiphol- 
Amaterdaa  airport.  Leiden,  Netherlands:  Instituut  voor  Praeventiave 
Ganaaakuuda  TNO,  Interim  Report  1R-1,  June,  1975.  (In  Dutch). 

The  workload  at  the  Amsterdam  airport  was  measured  with  a  view  to  analyzing  mental 
load  factors  and  to  studying  the  affect  of  task  performance  on  the  air  traffic 
controller.  Number  and  content  of  the  air  traffic  information  strips,  radio 
telephony  comunication,  coordination  with  other  air  traffic  sectors,  and  telephone 
calls  with  other  air  traffic  control  centers  were  registered  for  five  air  traffic 
controllers  during  the  week  of  Aug.  6,  1973.  The  results  of  the  task  analysis 
parameters  were  evaluated  and  preliminary  conclusions  were  made. 

W/L  Cat.  Code:  2.1.,  3.1,  4.1.10,  4.1.11 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp. ,  Experimental  Fiald  Flight  simulator 

time  assess. 

Primary  task  Primary  task 

Physio logical  Heart  race, 

h.r.  vj"t. 

Breathing  anal. 


Pasmooll ,  C.  K.  ,  Opmeer,  C.  H.  J.  M. ,  and  Hyndman,  B.  W-  Workload  in  air 
traffic  control.  In  T.  B.  Sheridan  and  G.  Johannsen  (Eds.)  Monitoring 
behavior  and  supervisory  control.  New  York:  Plenum  Press,  1976,  107-117. 

The  ever-increasing  number  of  flights  to  be  handled  during  a  given  time  period 
has  made  it  necesaary  to  increase  the  capacity  of  the  air  traffic  control  system. 
Inevitably  such  increases  place  extra  burdens  on  air  traffic  controllers,  e^en 
as  automaton  has  increased.  This  paper  reviews  methods  for  assessing  air  traffic 
controller  workloads,  and  indicates  which  methods  have  proven  successful. 
Subjective  ratings,  speech  workloed,  and  physiological  reaction  measures  appear 
most  reliable. 

W/L  Cat.  Code:  1. ,  4.1.3,  4.1.10,  4.3 

Op.  Behav.  Code:  1. ,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Field  Flight  Simulator 

Physiological  Heart  rate.  Review 

h.r.  var, 

Sueech  pattern 
anal. 
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Payne,  D.  R.  and  Buck,  J.  R.  Synthetic  switching  time  statistics.  Proceedings 
of  the  23rd  Annual  Meeting  cf  the  Human  Factors  Society,  Boston,  Massachusetts, 
October  29-November  1,  1979,  201-204. 

A  synthetic  (predetermined)  time  system  with  expected  times  and  time  variances 
appears  to  have  considerable  usefulness  in  the  design  of  panel  layouts  and  the 
estimation  of  operator  workloads,  particularly  during  early  developmental  phases 
of  a  system.  Acc  >rdingly,  the  study  was  made  to  see  if  a  synthetic  time  system 
could  be  devised  to  predict  the  time  statistics  for  setting  and  changing  various 
types  of  switches  as  a  function  of  several  variables.  Time  data  were  collected 
through  computerized  instrumentation  and  the  root-m^on-squares  of  tracking  errors 
were  collected  for  time  intervals  between  switching  task  events.  Analyses  are 
being  made  to  determine  the  repeatable  predictability  of  the  switching  time 
statistics,  the  influence  of  the  variables  on  these  statistics,  statistical 
independence  of  sequential  switching  times,  learning  effects  on  the  tracking  task, 
and  switching  task  interferences  on  the  tracking  task. 

W/L  Cat-  Code:  2.1.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4.] 

Spare  m.  capacity  Task  comp..  Experimental  Laboratory  Flight  simulator 

time  assess. 

Jrimary  task  Single  measures 


Pettyjohn.  F.S.,  McNeil,  R.J.,  Akers,  L.A.  and  Faber,  J.M.  Use  of  Inspiratory 
minute  volumes  in  evaluation  of  rotary  and  fixed  wing  pilot  workload. 

Proceedings  of  the  AGARD  Conference  on  Methods  to  Assess  Workload,  ACARD-CPP- 
216,  April,  1977,  A9-L  -  A9-2, 

Nap-o£-the-earth  (NOE),  night  nap-of-tbe-earth  (NNOE) ,  and  night  vision  devices 
(NVD)  have  added  markedly  to  the  workload  of  tbe  aircrew.  During  oxygen 
utilization  studies,  analysis  of  Inspriatory  Minute  Volume  (IMV)  data  indicated 
significant  trends  dependent  on  flight  profiles.  To  further  evaluate  this  method 
as  an  indirect  and  simple  modality  in  the  assessment  of  stress  and  workload,  a 
study  of  IMV  during  varied  helicopter  and  fixed  wing  aircraft  flight  profiles 
was  undertaken.  Data  were  obtained  from  a  series  of  135  flights  of  OH-58, 

UH-1H,  and  AH-1  helicopcers  and  U-21  and  C-2A  fixed  wing  aircraft.  Three  pnases 
of  the  flight  were  evaluated — takeoff  (T.O.),  cruise  (C),  and  final  approach  (F.A.). 
The  helicopter  flight  profile  was  evaluated  under  normal  flight,  NOE,  NNOE,  and 
NVD.  This  paper  describes  the  results  of  the  study. 

W/L  Cat  Code:  4.1.11 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Breathing  anal.  Experimental  Flight  test  Flight  simulator 

Flight  test 
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Pettyjohn,  F.  S.,  McNeil,  R.  J. ,  Akers,  L.  A.  and  Faber,  J.  M.  Use  of  inspiratory 
minute  volumes  in  evaluation  of  rotary  and  fixed  wing  pilot  workload.  Fort 
Rucker,  Alabama:  OS  Army  Aeromedical  Research  Laboratory,  USAARL  Report  No. 
77-9,  April,  1977.  (AD  039  854). 

Inspiratory  minute  volume  (IMV)  measurements  by  Mueller  Respi\ometer  were 
utilized  in  the  evaluation  of  US  Army  aircrew  workload  and  stress  in  helicopter 
and  fixed  wing  aircraft.  The  IMV  data  obtained  demonstrates  a  significant 
stress  and/or  workload  level  of  the  aviator  in  performance  of  helicopter  day 
nap-cf-the-earch  (NOE) ,  night  nap-of-the-earth  (NNOE)  and  with  the  use  of  night 
vision  devices  (NVD) .  IMV  of  20.05  to  38.11  liters  per  minute  NTPD  were 
obtained  during  the  performance  of  these  combat  operational  techniques.  TMV 
determination  in-flight  is  considered  a  valuable  clinical  tool  in  the  assess¬ 
ment  of  aircrew  stress  and/or  workload. 

W/L  Cat.  Code:  4.1.11 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Physiological  Breathing  anal.  Experimental  Flight  test  Flight  simulator 

Flight  test 


Pew,  R.W.  Secondary  tasks  and  workload  measurement.  In  N.  Moray  (Ed.)  Mental 
workload:  its  theory  and  measurement.  New  York:  Plenum  Press,  1979,  23-28. 

Spare  mental  capacity  concepts  of  mental  workload  are  discussed  and  the 
use  of  a  secondary  task  is  reviewed  as  a  possible  measuring  procedure. 

Various  considerations  and  problems  of  using  «  secondary  task  are  presented. 


W/L  Cat.  Code: 

Op.  oehe.v.  Code: 
Spare  m.  capacity 


2.2 

2.1,  4.1 
Subsidiary  task 


Construct 


None 


Flight  simulator 
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Pfendler,  C.  and  Joh&nnsen,  G.  Workload  measurement  and  operator  training  in 
simulated  STOL  approaches.  Meckenheim,  West  Germany:  Forshungsinstitut 
fur  Anthvopotechnik,  Report  No.  30,  October,  1977,  (In  German). 

Manual  ILS-approaches  were  performed  by  non-pilots  in  a  fixed  bnee  STOL-simulator. 
In  addition  to  performance  variables,  workload  was  assessed  with  a  secondary 
task  (tapping)  and  with  a  graphic  rating  scale.  Training  period  data  were  analyzed 
to  assure  that  learned  performance  was  stationary.  An  experienced  pilot  was  also 
tested.  The  performance  levels  of  the  subjects  were  comparable  to  those  of  the 
pilot.  During  the  rollowlng  experiments  data  were  collected  to  evaluate  the 
suitability  of  the  secondary  tark  and  the  rating  scale  as  measures  of  workload 
for  the  mentioned  guidance  and  control  task.  The  evaluation  techniques  used  are 
based  on  psychological  test  theory  and  are  suitable  for  comparing  workload 
measures,  The  report  also  contains  an  overview  on  selected  aspects  of  sensory- 
motor  learning  and  on  workload  measurement  techniques. 


W/L  Cat.  Code: 

1.1,  2.2.2,  3.1 

Op.  Behav.  Code: 

1.,  2.,  4. 

Opinion 

Rating  scale  Experimental  Flight  simulator 

Flight  simulator 

Spare  m.  capacity 

Subsidiary  task 

Flight  test 

Primary  task 

Single  measures 

Phatak,  A.  V.  Improvement  in  weapon  rystem  effectiveness  by  application  of 
identification  methods  for  determining  human  operator  performance  decrements 
under  stress  conditions.  Palo  Alto,  California:  Systems  Control,  December,  1973. 
(AD  773  856). 

This  report  considers  the  development  of  realistic  models  for  weapon  system  con¬ 
trollers  which  could  be  used  to  predict  the  effectiveness  of  manned  weapon  systemo 
under  stress  conditions.  Two  types  of  models  con  idered:  (1)  the  input-cutput 
stochastic  linear  state-variable  models  (equivalent  to  detcribing  function  models 
when  process  noise  =0),  and  (2)  die  optimal  control  model  developed  by  Xleinman 
et  al.  The  maximum  likelihood  ldeutif icatlon  technique  was  used  in  estimating 
model  parameters  from  Input  output  data.  Results  show  that-  the  identification 
algorithm  was  highly  successful  in  identifying  the  parameters  of  the  stochastic 
state  variable  models.  However,  difficulties  were  encountered  in  applying  the 
technique  to  identifying  parameters  of  the  optimal  control  .Aodel.  Both  system 
performance  and  system  difficulty  are  related  in  some  way  to  the  human  operator 
parameters.  Operator  workload  (and  pilot  opinion  rating)  is  some  linear  or  non¬ 
linear  combination  of  system-  performance  and  system  difficulty.  There  is,  therefore, 
a  clear  reed  to  develop  some  kind  of  a  metric  for  system  difficulty.  This  world 
involve  further  investigation  into  the  areas  of  system  controllability t  observability 


and  identifiability. 

W/L  Cat.  Code:  3.3 

Od.  Behav.  Code:  1. , 

2.,  4. 

Primary  task  Math. 

raodei  Construct 

Simulator 

Flight  simulator 

liight  test 
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Philipp,  U.,  Rrfiche,  P.  and  Kirchner,  J.  H.  The  use  of  subjective  rating. 
Ergonomics,  1971,  14,  611-616. 

To  evaluate  work  load  In  ATC-tasks  the  method  cf  subjective  rating  has  been 
applied  in  addition  to  .".he  recording  of  physiological  data  and  objective  work 
factors,  A  scoring  method  and  a  procedure  for  observer  rating  have  been  used 
to  record  variations  in  the  subjective  feeling  cf  workload  The  results  of 
subjective  rating  have  been  related  to  different  measures  of  information 
processing.  Some  problems  concerning  the  influence  of  individual  capacity  in 
the  procedure  of  observer  rating  for  the  evaluation  of  workload  and  the 
difficulties  in  defining  ''difficulty  of  the  control  task”  are  discussed. 

W/L  Cat,.  Code:  1.1 

Or-.  Behav.  Code:  2.1,  3. 

Opinion  Rating  scale  Experimental  Fielu  Flight  simulator 

Spare  m.  Task  comp..  Flight  test 

capacity  time  assess. 

Primary  Single 

task  measures 


Phillips,  J.  E.  The  feasibility  ot"  short  interval  time  estimation  as  a 

aethodology  to  forecast  human  performance  of  a  specified  task.  Red  River 
Army  Depot ,  T  CXo  t  <CSuS  |  Texas:  D  ARC  OK  lutein  Training  Center,  BARCOM*ITC— O'*-  -03™ 
76-010,  April,  1976.  (AD  A026  727). 

This  paper  proposes  and  initiates  the  testing  of  the  hypothesis  which  states 
that  "Ar.  estimate  of  a  short  interval  of  time  will  indicate  one’s  ability  to 
perform  &  specified  task  relative  to  his  ability  to  perform  thir.  same'  task  at 
other  poiuts  in  time  throughout  the  day."  This  investigation  includes  a  survey 
of  previous  time  estimation  research  and  other  related  chrcnobiologic  studies. 

This  study  examines  the  interval  estimation-task  performance  relationship  by 
correlating  two  short  internals  of  time  with  performance  of  a  letter  cancellation 
task.  Although  results  showed  that  the  hypothesis  may  be  valid  for  certain 
individuals,  as  two  of  the  three  tested  subjects'  performances  appeared  to  be 
closel”  related  to  their  estimations  of  an  unrehearsed  fifteen  second  interval, 
future  studies  are  needed  to  determine  whether  any  class  or  classes  of  tasks 
produce  this  interval  estimation-task  performance  relationship  in  all  pecsons. 

This  paper  suggests  that  six  future  time  estimation  research  employ  unrehearsed 
interval-*  for  testing. 

W/L  Cat.  Cede:  i.2.3 

Op  3ehav .  Code :  1.2,  2 . ,  4.1 

Spare  ti.  capacity  Tine  estimation  Experimental  orboretory  Background 
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Posner,  M.  I.  and  Buies.  S.  J.  Components  of  attention.  Psvchcloglcal  Review, 

1971,  78,  3S1-408. 

The  study  of  human  attention  may  be  divided  into  three  components.  These  are 
alertness,  selectivity,  and  processing  capacity.  This  paper  outlines  experimental 
techniques  designed  to  separate  these  components  and  examine  their  interrelations 
within  comparable  tasks.  It  is  shown  that  a  stimulus  may  be  used  to  increase 
alertness  for  processing  all  external  information,  to  improve  selection  of 
particular  stimuli,  or  to  do  both  simultaneously .  Development  of  alertness  and 
s*>J.ectivity  are  separable,  but  they  may  go  on  together  without  interference. 

Moreover,  encoding  a  stimulus  may  proceed  without  producing  interference  with 

other  signals.  Limited  capacity  results  are  obtained  when  mental  operations 

such  as  response  selection  or  rehearsal  must  be  performed  on  the  encoded  information. 

W/L  Cat.  Code:  2.1.1,  2.1.2 

Op.  Behav.  Code:  1. ,  2. 

Spare  m.  capacity  Task  comp..  Construct  None  Background 

time  assess. 

Inform,  theory 


Poston ,  A.  M.  A  survey  of  existing  computer  programs  for  aircrew  workload 

assessment.  Aberdeen  Proving  Ground,  Maryland:  U.S.  Army  Human  Engineering 
Laboratory,  Techuicai  Memorandum  13-78,  May,  1978.  (AD  A058  518). 

Due  to  increased  concerns  of  crew  workload  in  tactical  n.v>*of-Lbe-earth 
environments,  increased  importance  has  been  placed  on  the  need  to  utilize  a 
computer  simulation  to  serve  as  a  predictor,  or  estimator,  of  crew  loading. 

The  OS  Army  Kvmai.  Engineering  Laboratory  conducted  a.  survey  of  existing 
computer  programs  which  can  be  used  for  workload  assessment.  Each  program 
we*  assessed  ir  teres  of  iu?ut  requirements,  processing  procedures,  outputs 
available,  as  well,  as  any  other  pertinent  information.  Conclusions  are  drawn 
and  recomcwsndstiona  are  made  as  to  how  the  Army  should  approach  the  problem 
of  obtaining  a  suitable  cotrpucer  program. 

W/L  Car,  Code:  2.1.1 

Op.  Befiav.  Code:  1. ,  ,  3.,  4. 

Spare  m.  capacity  Tark  comp..  Review  None  Flight  simulator 

time  assess. 
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Potempa,  K.W.  A  catalog  of  human-factors  techniques  for  testing  new  systems. 

Wright-Patterson  AFB,  Ohio:  USAF  Human  Resources  Laboratory,  / 2HRVTR-68-15 , 

February,  1969.  (AD  854  482). 

The  purpose  of  the  described  technique  is  to  determine  decrement  In  mission-related 
performance  of  system  operators  as  a  result  of  increased  workload.  The  study  was 
performed  under  dynamic  conditions  on  a  Dyne-soar  flight  simulator.  Workload  was 
increased  through  ineertiou  of  external  conditions  and  aall'unctic  is  such  as  shear 
winds,  oxygen  pressure  losses,  etc.  Performance  decrement  was  monitored  by  recording 
flight  control  movements  and  rates  and  by  having  pilots  report,  an  regular  intervals* 
the  status  of  10  mission-relevant  items.  The  pilot's  ability  to  uonitor  and 
report  the  10  test  items  was  determined  through  scheduled  verbal  reports  over  the 
simulated  radio  subsystem.  Monitoring  and  measuring  high  prioritj'  items  such  as 
deviations  in  altitude,  air  speed,  and  course  heading  had  been  found  to  show  little 
change  affected  by  workload;  therefore,  tasks  considered  to  be  of  secondary,  but 
still  mission-essential,  importance  were  used  as  performance  measures  iu  this  study. 
As  the  workload  Increased,  the  verbal  reports  of  the  pilots  reflected  progressive 
breakdown,  first  of  continuity  and  then  of  content  also.  The  interpretation  of 
this  was  that  the  pilots  were  concent rating  more  on  flight-critical  tasks  and  less 
on  nonf light-critical  assignments.  A  similar  and  concurrent  work! oad- related 
finding  was  that  small  control  stick  movements  dropped  in  number,  /hile  gross 
control  movements  increased,  indicating  a  degradation  of  flying  abLlity. 

W/L  Cat.  Code:  2.2.1,  3.2,  4.3 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Mult,  measure  Flight  test 

Phx’sioloaical  Speech  patt..  anal. 


rrlce,  D.  L.  The  effects  of  certain  gimbal  orders  on  target  acquisition  and 
workload.  Human  Factors,  1975,  JL7,  571-576. 

If  air-to-ground  imaging  sensors  are  moun^d  to  aircraft  by  different  gimbal 
order  systems,  the  displayed  scene  will  rotate  differently,  even  though  the 
flight  paths  are  identical.  Eighteen  experienced  pilots  were  tested  to 
investigate  the  effect?  of  three  gimbal  orders  (roll-pitch,  yaw-pitch,  and 
pitch-yaw)  on  target  detection,  recognition,  and  identification  performance, 
and  also  on  operator  workload.  The  pitch-yaw  gimbal  order  was  associated 
with  the  greatest  range-to- target  scores  and  the  lightest  workloads.  Workload 
was  assessed  by  means  of  a  digit-reading  secondary  task. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1. 

Spare  m.  opacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 

Primary  task  Single  measures  Flight  simulator  Flight  test 
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Price,  n.  E.  Development  of  potential  roles  of  supersonic  transport  crews. 
Chatsvorth,  California:  Serendipity  Associates,  TR  20-66-3,  December,  1965. 

This  report  presents  a  synopsis  of  the  methodological  approach  and  techniaues 
used  throughout  the  entire  contract.  Much  of  the  method  used  is  explicit  in 
the  reports  of  the  study,  and  this  report  is  Intended  to  synthesize  or 
summarize  the  method.  In  addition  to  presenting  the  method  used  for  the  SST 
study,  an  attempt  was  made  to  generalise  the  method  so  that  it  might  be  applied 
to  other  studies  concerned  vith  the  derivation  or  investigation  of  crew 
requirements  in  other  manned  systems.  This  general  approach  to  study  of  crew 
requirements  evolved  during  the  SST  crew  requirements  study  and  Incorporates 
methodological  improvements  resulting  from  the  study.  Throughout  this  report, 
the  general  approach  to  a  crew  requirements  study  will  be  outlined  after  related 
aspects  of  the  SST  study. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Cone:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp. ,  Construct  Laboratory  Flight  simulator 

time  assess. 


Price,  H.  E. ,  Honsberger,  W.  D. ,  and  Ereneta,  W.  J.  A  study  of  potential  roles 
of  supersonic  transport  crews  and  some  implications  for  the  flight  deck. 

Volume  I:  Workload,  crew  roles,  flight  deck  concepts,  and  conclusions. 

Moffett  Field,  California:  Rational  Aeronautics  and  Space  Administration. 

Amea  Research  Center,  Contractor's  Report,  NASA  CR-561,  October,  1966. 

The  study  was  conducted  largely  as  a  field  research  and  literature  survey  program 
to  synthesize  requirements  and  constraints  relative  to  potential  crew  roles  and  to 
review  technical  concepts  for  implementing  SST  operational  functions  with  emphasis 
on  potential  crew  participation.  An  analysis  of  the  data  so  developed  was 
conducted  to  investigate  crew  workload,  distribution  of  this  workload  among 
different  numbers  of  crew  members  to  define  potential  crew  roles,  and 
implications  of  these  potential  roles  for  flight  deck  design. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp..  Construct  Laboratory  Flight  simulator 

time  assess. 
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Pritsker,  A.  A.  B. ,  Wortuan,  D.  B. ,  Scum,  C.  S. ,  Chubb*  G.  P.  and  Seifert,  D,  J. 
SAINT;  Volume  I.  Systems  analysis  of  integrated  network  of  tasks.  Wright* 
Patterson  AFB,  Ohio:  Aerospace  Medical  Research  Laboratory,  AMRL-TR-73-126, 
April,  1974.  (AD  A014  80). 

A  simulation  approach  is  used  to  obtain  the  performance  measures.  Human 
Engineering  considerations  are  Included  through  parameters  associated  with 
tasks  precedence  relations  between  tasks  and  factors  affecting  crew  performance. 
SAINT  is  both  a  modeling  procedure  and  an  analysis  technique.  The  analysis  is 
performed  by  a  digital  computer  program  which  accepts  input  data  concerning 
tasks  and  performs  two  types  of  analysis.  First,  SAINT  performs  benchmark 
iterations  to  obtain  estimates  of  the  time  requirements  on  the  operators 
performing  the  nait.l'm.  Estimates  of  essential  time  remaining,  nonesaentlal 
ft~.^  remaining,  and  waiting  time  for  various  segments  of  a  mission  are  computed. 
Second,  SAINT  obtains  mission  performance  measures  which  provide  estimates  of 
the  probability  of  successfully  completing  the  mission  under  stress  and  adverse 
environmental  conditions.  This  report  presents  the  methods  for  using  SAINT, 
Including  the  preparation  of  input  data  and  the  interpretation  of  output  reports. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Task  comp..  Construct  None  Flight  simulator 

time  assess. 


Proceeding  • '  '  the  osiuin  on  Man-System  Interface:  Advances  in  Workload 

Study  -.■wb-ag**-  D.  C. :  Air  Line  Pilots  Association,  July  31,  August  1,  1978. 

This  documr  it  provides  brief  summaries  of  ongoing  research  in  workload  estimation 
techniques  for  flight-deck  applications.  Techniques  described  Include  human 
operator  models,  time-estimation,  time-line  analysis,  performance,  and  a  variety 
of  physiological  measures  including  evoked  potenti  ils  and  pupil  dilation.  The 
contributions  of  twelve  researchers  are  included. 


W/L  Cat .  Code : 

Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 
Physiological 


2.1.1,  2.2.1,  2.2.3,  3.1, 


3.3,  4.1.5,  4.1.6,  4.1.8 


Multiple 


Review  Laboratory 

Construct 

Experimental 


Flight  simulator 
Flight  test 
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Rashman,  S.  M.  The  function  of  external  respiration  in  mental  activity. 
Flalologlchnli  Zhurnal.  1972,  18,  361-366.  (In  Ukrainian.) 

This  paper  describes  an  investigation  of  the  changes  affecting  the  excernal 
respiration  and  cardiovascular  systems  during  Intense  mental  acitivity  (namely, 
problem  solution  in  mathematical  analysis).  Data  are  reviewed  on:  changes  in 
arterial  blood  saturation  b  oxygen;  respiratory  frequency,  capacity,  and  minute 
volume;  oxygen  consumption  and  intake  coefficient;  ventilation  equivalent;  and  a 
number  of  psycho-physiological  indices  characterizing  the  state  of  cortical 
processes  during  Intense  mental  activity. 

W/L  Cat.  Code:  4.1.5,  4.1.10,  4.1.11 

Op.  Behav.  Code:  1.,  2. 

Physiological  Multiple  Experimental  Laboratory  Flight  simulator 


Rasmussen,  J,  Reflections  on  the  concept  of  operator  workload.  In  N.  Moray  (Ed.) 
Mental  workload:  lte  theory  and  measurement.  New  York:  ■  Plenum  Press, 

1979,  29-40.  ' 


In  future  complex  systems,  man  is  typically  allocated  functions  as  a  monitor 
and  supervisor.  Models  of  Lla  performance  must  not  only  be  able  to  predict 
his  average  response  in  frequent  situations,  bur  also  his  response  in  unique, 
infrequent  tasks.  He  is  a  highly  adaptive  and  goul  oriented  information 
processor.  Models  of  his  performance  in  well  adapted  situations  are  mainly 
models  of  his  environment.  Models  of  his  performance  must  also  reflect  the 
limiting  properties  of  his  internal  mechanisms. 

W/L  Cat.  Code:  3.3 

Op.  Behav.  Code:  1.,  2.,  4, 

Primary  task  Hath .  model  Construct  None  Flight  simulator 
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Rault,  A,  Pxlot  workload  analysis.  In  T  B.  Sheridan  and  G.  Johannsen  (Eds.) 

Monitoring  behavior  and  supervisory  control.  New  York;  Plenum  Prsso, 

1976,  139-153. 

This  paper  describes  the  Initial  phases  of  a  multidisciplinary  study  of  pilot 
workload  estimation.  Both  simulated  and  actual  helicopter  flight  tesf.3  are  being 
performed.  The  goal  has  been  to  find  a  ouantitative  definition  of  workload  through 
the  use  of  different  approaches.  Measures  taken  included;  cardiac  rhythm, 
electromyography  of  neck  muscles,  pulmonary  ventilation,  eye  movements,  information 
theoretic  formulations,  and  parameters  from  dynamic  models.  Results  of  these 
measures  are  being  compared  against  Cooper  scale  ratings. 


W/L  Cat.  Code: 

1.1,  2.1.2, 

3.3,  4.1.3,  4.1.4, 

4.1.7, 

4.1.9,  4.1 

.10,  4.1.11 

Op.  Behav.  Code: 

1 . ,  2 . ,  4 . 

Opinion 

Multiple 

Construct 

Flight 

simulator 

Flight  simulator 

Spare  ra.  capacity 

Experimental 

Flight 

test 

Flight  test 

Primary  task 

Physiological 

Raulc,  A.  Measurement  of  pilot  workload.  In  Ni  Moray  (Ed.)  Mental  workoad; 
its  theory  and  measurement.  New  York;  Plenum  Press,  1979,  417-422. 

Various  approaches  involving  psychological  t^sts,  physiological  measures 
(heart  rate  variabtlitv.  EMG  *J«d  Knn\  ^nfnmai’4n«  «-v  .id  an  A  r~  on  A  *,«»1 

• —  u  t  *  -  j  — —  —  |  ■•••  *  »»»  ■■■%»  v»wk*  ^nww  A.  jr  |  wtisi  oyu  i.  a  V4. 

theory  were  used  in  parallel  to  assess  pilot  workload.  Issues  are  discussed 
pertaining  to  the  use  of  these  approaches. 


W/L  Cat.  Code; 

Op.  Behav.  Cola: 
Opinion 

Spare  m.  capacity 
Primary  task 
Fhyeiological 


1.1,  2.1.2,  3.3,  4.1.4,  4.1.7 
1. ,  2. ,  4. 

Multiple  Construct 


None  Flight  simulator 

Flight  test 
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Reich*ss  D. »  Kirchner,  J.  H.r  and  LauvJlg,  V.  Evaluation  of  stress  factors  by 
analysis  of  rudxo-telecomauni cation  in  ATC.  Ergonomics .  3971,  14,  603-609. 

Information  content  analysis  baoad  on  information  theory  can  be  used  to  evaluate 
strc.se  in  controllers.  The  i-iethod  is  applivi  to  the  analysis  of  radi .telecommunication 
in  air  traffic  control.  Massage  type?  are  defined  and  their  information  content 
is  evaluated  using  the  syntactic  level  of  information.  Belated  to  time,  the 
measurements  .  f  information,  provide  a  stress  factor  Preliminary  results  Indicate 
tae  usefulness  of  the  method. 

W/L  Cat.  Coda:  2.1 

Op.  Behav.  Code:  1.,.  2.,  3.,  4.1 

Spare  m.  rapacity  Tash  comp  ,  Construct  Field  Flight  simulator 

time  assess. 

Inform,  theory  Experimental  Flight  test 


Raising,  J.  M.  The  definition  and  measurement  of  pilot  workload.  Wright- 
Patternon  AFBj  Ohio:  USAF  Flight  Dynamics  Laboratory,  AFFDL-TM- 7 2 -4-FGR , 
February,  1972. 

This  report  it  designed  as  an  oven-lew  cf  the  state-of-the-art  on  workload. 

It  is  divided  into  sever,  sections.  Section  I  provides  background  information 

on  the  relevance  of  workload  to  the  piloting  task.  Section  II  describes 

the  complexity  of  workload  and  why  there  is  i>.o  muc.i  confusion  connected  with 

it.  Sections  III  aod  17  discus*,  respectively,  the  physiological  and  psychological 

measures  of  workload.  Section  V  describes  various  datK  analysis  techniques 

used  in  conjunction  with  th  >  measurement  of  workload.  Section  VI  evaluates 

the  current  state-of-the-art.  in  workload  measurement,  and  Section  VIJ  Jlscusses 

the  anol  cations  Of  workload  measurement  on  the  Crew  Station  Management 

Program,  witn  etaphcais  on  multidimensional  approaches. 

W/L  Cat.  Coda:  1. ,  2. ,  3. ,  4. 

Op.  fiehav.  Code:  i,  2.,  4. 

Opinion  Multiple  Review  Nc..e 

Spars  m.  capacity 
Primary  task 
Physiological 


Fight  simulator 
Flight,  test 


?3o 


4->r  A*mt  -m,  smumi 
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Repa,  B.  S.  and  Wiarvilla,  W.  V.  Driver  performance  in  controlling  a  driving 
simulator  with  varying  vehicle  response  characteristics.  SAE  Paper  No. 

760779,  October,  1976. 

This  paper  describes  the  effects  of  variations  in  vehicle  response  characteristics 
on  driver ‘Vehicle  disturbance  responses  using  a  moving  base  driving  simulator. 

Two  exploratory  studies  are  discussed,  one  dealing  with  vehicle  transient 
response  characteristics  and  the  other  with  steady  state  characteristics. 

Close  correspondence  with  full-scale  data  reported  by  others  indicates  that 
dynamically  realistic  simulators  can  be  effective  research  tools.  The 
flexibility  of  the  simulator  has  facilitated  the  collection  of  other  preliminary 
data  which  extend  the  full-scale  findings.  Considerably  more  effort  will  be 
needed,  however,  before  strong  arguments  either  for  or  against  specific  parameter 
boundaries  can  be  made. 

W/L  Cat.  Code:  1.1,  3.2 


Op.  Behav.  Code:  2.,  4. 


Opinion 

Ratings 

Experimental 

Simulator 

Flight  simulator 

Primary  task 

Mult,  measures 

Flight  test 

Repko,  J.D.,  Loeb,  H.  and  brown,  B.R.  Behavioral  effects  of  prolonged  exposure 
to  continuous  and  intermittent  noise.  Louisville,  Kentucky:  University  of 
Louiaville,  Performance  Resear  :h  Laboratory,  ITR-74-29,  June,  197'' . 


The  puspoae  of  this  investigation  wafl  to  assess  man's  performance  in  a  work 
situation  wherein  90  dB  continuous  and  periodic  96  dB  Intermittent  noise  were 
separately  presented  as  environmental  stressors.  The  present  study  employed  a 
synthetic-work  approach  in  v* ich  several  tasks  were  combined  into  a  multiple- 
task  performance  battery  (Wit  B) .  An  index  of  general  performance  was  employed  to 
assess  the  over-all  work  behavior  of  the  Ss .  The  results  showed  that  the  mean 
percentage  of  baseline  performance  was  enhanced  by  a  periodic  96  dB  intermittent 
noise.  On  the  other  hand,  since  continuous  uoise  may  be  considered  as  containing 
fever  stimulus  elements  than  intermittent  noise,  it  was  expected,  that  general 
performance  during  continuous  nciae  would  be  less  than  during  intermittent  noise. 
Ute  nature  of  the  results  obtained  with  the  S.  dB  continuous  noise  indicated  that 
the  condition  neither  enhanced  nor  degraded  performance. 


W/L  Cat.  Code:  3.2 

Op.  Behav.  Code:  1.,  2.,  4. 


Primary  task 


Mult,  measures 


Experimental 


Laboratory  Flight  simulator 
Flight  test 
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•r. 

Rap log la,  C.  K.(  Holden,  F.  H. ,  Cold,  &.  E.,  Kulak,  L.  L. ,  Jonas,  F.  and  Potor, 

0.  ,  Jr.  Huaan  operator  performance  In  hypoxic  stress.  Wrlght-Patteraon 
AFB,  Ohio:  JSAF  Aerospace  Medical  Research  Laboratory,  AMRL-TR-71-29, 

Paper  No.  31,  December,  1971.  (AD  740  458). 

This  exp 2 r law  at  was  designed  to  assess  the  value  of  several  different  tracking 
tasks  In  quantitatively  measuring  the  effects  of  hypoxia  on  huaan  operator 
performance.  Bach  subject  was  required  to  perform  three  tracking  tasks.  One 
was  an  adaptive  first  order  unstable  task.  The  second  represented  stable  third 
order  longitudinal  airframe  dynamics.  The  last  was  a  two  axis  combination  of 
the  first  two,  with  the  stable  task  represented  by  the  vertical  display  axis 
and  the  unatable  task  on  the  horisontal  axis.  Hypoxic  stress  was  simulated  by 
breathing  02,  N2  mixtures  representing  sea  level,  12,000  ft  and  22,000  ft  altitude. 
The  studies  employed  six  well  trained  subjects  breathing  the  appropriate  gas 
mixtures  for  two  minutes.  The  experimental  factors  were  randomly  ordered  with 
two  replications  per  set  of  factors.  A  two  by  two  analysis  of  variance  was 
employed  to  provide  estimates  of  the  reliability  of  the  measurements.  The 
results  Indicate  that  the  adaptive  unstable  task  is  significantly  sensitive  to 
hypoxic  stress,  whereas  to  Identify  similar  changes  in  the  stable  task  requires 
frequency  domain  analysis.  There  Is  some  indication  that  the  unstable  task  may 
be  sensitive  to  12,000  ft  simulated  hypoxia  after  only  2  minutes  of  exposure. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  tank  Single  measures  Experimental  Laboratory  Flight  test 
Physiological 

Rlngland,  R.  F. ,  and  Craig,  S.  J.  A  survey  of  piloting  factors  in  fixed-wing 

V/STOL  aircraft.  In  Atmospheric.  Flight  Mechanics  Conference,  Technical  Papers. 
Hollywood,  Florida,  August  8-10,  19/7,  American  Institute  of  Aeronautics  mad 
Astronautics,  .977,  239-246. 

This  paper  summarises  the  key  reaults  of  a  recently  completed  review  of  the 
available  literature  pertaining  to  piloting  factors  In  fixed-wing  V/STOL  aircraft 
design.  It  emphasizes  mission-  and  vehicle-related  factors  which  are  peculiar  to 
the  V/STOL  concept  and  which  determine  the  control/display  system  requirements. 

The  review  shows  excessive  pilot  workload  originating  primarily  in  the  control 
aspects  of  the  aircraft  to  be  the  central  problem  in  past  designs.  These  aspects 
Include  management  of  the  propulsion/lift  systems  during  conversion,  stabilization 
of  vehicle  attitude,  tor*d  rhe  stabilization  and  control  of  the  aircraft’s  speed 
and  path  angle  responses.  Results  show  display  technology  improvements  alone 
cannot  solve  these  piloting  problems  without  control  augmentation  because  the 
pilot's  capability  remains  overtaxed. 

W/L  Cat.  Coie:  2.1.1,  3.3 

Op.  Behav.  Code:  1.,  2.,  \ . 2 

Spare  m.  capacity  Task  comg . ,  Review  None  Flight  simulator 

time  assess. 

Primary  task  Math,  model  Construct 
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Roedingar,  H.  L. ,  III,  Knight,  J.  L. ,  .Jr.,  and  Kantovitt,  B.  H.  Inferring 
decay  in  short-term  memory:  the  iasuc  of  capacity.  Memory  and  Cognition. 

1977,  5,  167-176. 

Experiments  examining  the  issue  of  decay  in  short-term  memory  have  assumed  a  single 
undifferentiated  source  of  processing  capacity  which  cannot  be  devoted  to  rehearsal 
when  consumed  in  the  processing  of  a  nonverbal  Interpolated  task.  Three  experi¬ 
ments  reported  here  call  this  logic  into  question,  since  variations  In  difficulty 
in  the  nonverbal  Interpolated  '■ask  failed  to  affect  recall.  Slight  forgetting 
produced  by  a  nonverbal  interpolated  task,  relative  to  a  no  interpolated  task  control, 
was  attributed  to  qualitative  differences  from  performing  two  tasks  simultaneously 
rather  than  only  one.  Results  from  the  third  experiment  indicated  that  retrieval 
after,  a  period  of  nonverbal  interpolated  activity  is  from  primary  rather  than 
secondary  memory. 

W/L  Cat.  Code:  2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4.1 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 

Primary  task  Single  measures 


Rohmert,  W.  An  international  symposium  on  objective  assessment  of  workload 

in  .air  traffic  control  tasks:  Held  at  the  Institute  of  Arbeitswissenschaft, 
The  University  of  Technology,  Darmstadt,  German  Fede-ai  Republic.  Ergonomics , 
1971 ,  14,  545-547. 

The  first  International  Symposium  on  Objective  Assessment  of  Work  Load  in 
Air  Traffic  Control  Tasks,  arranged  by  the  ’Stress  in  Air  Traffic  Coutrol 
Research  Association — SATCRA’  in  June  1971  at  Darmstadt,  is  introduced.  A 
distinction  is  made  between  objective  methods  and  results  of  the  determination 
of  stress  of  work  task3  end  subjective  strain  on  the  controllers  due  to  these 
stressing  factors.  Certain  stressors  cause  different  strain  in  different 
controllers  because  of  their  different  Individual  capacities  and  abilities. 
Methods  and  equipment  for  determining  individual  capacities  and  approaches 
for  correlating  stress  and  strain  are  described. 

W/L  Cat.  Code:  1,,  2..  3.,  4. 

Op .  Behav .  Code :  1.,  2.,  3.,  4. 

Opinion  Multiple  Review 

Spare  m.  capacity 
Primary  task 
Physiological 


None  Flight  simulator 
Flight  test 
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Rohmer t,  W.  Determination  of  strata  and  strain  of  air  traffic  control  officers. 

Proceedings  of  the  AGARD  Conference  on  Methods  to  Assess  Workload,  ACARD-CPP- 

516 ,  April,  1977,  AsPl  -  \b-Y. 

Frankfurt  airport  several  field  studies  were  carried  out  over  a  period  of 
roughly  four  years  including  research  on  about  115  air-traffic  control-officers. 
Methods  were  developed  for  assessment  of  stress  i.nd  strain.  Stress  Is  defined 
as  all  factors  of  work  which  result  in  reactions  of  the  controller's  receptory 
and  effectory  system.  Strain  in  human  beings  is  now  only  lependent  on  stress 
but  also  on  distinguishing  Individual  characteristics.  An  overview  of  all  methods 
and  techniques  used  for  assessment  of  stress  and  strain  Is  presented.  Based  on 
the  uancept  of  the  aan-at-work  system  and  the  description  of  strain-related  work 
contents,  a  new  Ergonomic  Job  Description  Questionnaire  has  been  developed,  the 
results  of  which  allow  a  deeper  look  into  methods  and  techniques  needed  in 
designing  future  air-traffic  control-systems.  Results  of  some  of  the  field  studies 
in  sir-traffic  control  research  are  illustrated. 


W/L  Cat.  Code:  1.2,  2.1.1,  A. 1.3,  A. 1.5,  A. 1.10 

Op.  Behav.  Code:  1.1,  2.1 


Opinion  Multiple 

Ravisw 

Field 

Flight  aimuletor 

Spars  m.  capacity 

Flight  test 

Physiological 

Rohmert,  W.  Determination  of  stress  and  strain  at  real  work  places:  methods 
and  results  of  field  studies  with  air  traffic  contr,,'l  officers.  To  N.  Moray 
(F.d.)  Mantel  workload:  ita  theory  and  measurement.  New  York:  Plenum  Press, 

IS 79,  A23-A43. 

This  paper  begins  with  s  description  of  the  air  traffic  control ler'e  tuskr,  including 
the  demands,  behaviors,  and  capacities.  Subsequently,  techniques  for  measuring 
strass  and  strain  are  described:  motion  analysis,  information  contant  analysis, 
time-budget  study,  physiological  study,  psychological  etudy,  and  work  medicine. 

The  results  obtained  using  each  cf  cheae  techniques  are  presented. 

W/L  Cat.  Code:  2.1,  3.1,  A. 1.3,  4,1. A,  A. 1.9,  A. 1.10,  A. 1.12 

Op.  Bah." v .  Cade:  1.,  2.,  3.,  A. 

jpa.a  m.  capacity  Multiple  Experimental  Field  Flight  simulator 

Primary  teak 

Physiological 
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Rohnert,  W. ,  Laurlg,  W. ,  Philipp,  U.  and  Lucrak,  H.  Heart  rate  variability  and 
work-load  measurement  Ergonomics ,  1973,  16,  33-44. 

Heart  rate  variability  is  a  result  of  the  superimposition  of  different  sources 
of  variation  which  are  syrtsmised.  Three  paranetsrs  are  used  to  describe  the 
phenomenon  of  heart  rate  variation.  The  range  cf  variation  of  these  parameters 
is  discussed  using  examples  from  both  laboratory  and  field  investigations. 
Analyses  demonstrate  a  correlation  between  heart  rates  and  their  variability. 
Discussion  of  the  variation  of  the  chocen  parameters  suggests  that,  when  heart 
rate  variability  la  used  as  a  measure  of  strain  in  field  research  strain  might 
be  under-aesesoed. 

W/L  Cat.  Code:  4.1.10 
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Rolf <i ,  J.  M.  Multiple  task  performance:  Operator  overload.  Occupational 
Psychology ,  1971,  45,  125-132. 

This  paper  considers  some  of  the  problems  arising  from  the  changing  content 
of  human  wprk,  for  example  inciaa,’',d  vehicle  performance  and  the  reduction 
in  crew  complement  which  often  accompanies  it.  Some  of  the  psychological 
factors  which  Influence  human  response  in  such  situations  are  discussed. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  i.t  2.,  4. 
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Rolfe,  J.  M,  Whither  workload.  Applied  Ergonomics.  1973,  4^  8-10. 4 

Although  the  demands  placed  on  flight  deck  personnel  are  not  continuously 
excessive,  the  short  periods  of  high  load  combine  to  produce  a  cumulative 
effect  at  the  end  of  an  operation.  At  the  RAF  Institute  of  Aviation  Medicine, 
aircrew  are  examined  on  their  in-flight  workload  by  a  questionnaire  nethnd 
and  this  is  compared  with  other  methods  including  physiological  measurement. 
The  effects  of  work  away  from  tho  flight  deck,  and  of  factors  peripheral  to 
the  job  situation,  are  considered,  and  it  Is  suggested  that  care  must  be 
taken  to  avoid  eliminating  job  satisfaction  with  reduction,  in  workload. 

W/L  Cat.  Code;  1.2,  4.2 

Op.  Behav.  Code:  2.1,  4.2 

Opluion  Questionnaire  Review  Flight  simulator  Flight  simulator 

Physiological  Mult,  measures  Flight  test  Flight  test 


Rolfe,  J.  M.  The  secondary  task  as  a  measure  of  mental  load.  Iu  V?.  T, 

Singleton,  J.  G.  Fox,  and  D.  Whitfield  (Eds.)  Measurement  of  Man  at  Work. 
London:  Taylor  and  Francis,  1973,  135-148. 

The  human  operator  can  be  viewed  as  a  single  channel  data  processing  system, 
having  its  limitations  in  the  central  decision  mechanism  which  must  be  allowed 
a  finite  time  to  process  one  stimulus-response  before  a  second  can  be  accepted. 
Evidence  for  this  view  has  come  from  the  study  of  the  phenomenon  known  at  the 
poycbologlcd  refractory  period.  This  paper  reviews  the  ramifications  of  the 
single  channel  hypothesis  and  the  use  of  secondary  task&  to  measure  mental 
workload.  The  effects  of  learning,  experimental  shortcomings,  range  of 
applications,  interference,  and  validation  are  discussed. 

V, L  Cat .  Code :  2.2. 
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Rolfe,  J.  M.  The  measurement  of  human  response  its  man-vehicle  control 

situations.  In  T.  B.  Sheridan  and  C.  Johanneen  (Eds.)  Monitoring  behavior 
and  supervisory  control.  New  Yorks  Plenum  Prere,  1976,  125-137. 

This  paper  reviews  the  measurement  of  human  response  in  vehicular  cor.rol 
situations,  and  describes  the  relationship  between  such  measurements  and  vehicle 
design.  A  number  of  specific  categories  of  response  assessment  are  idsntifled, 
including  performance  requirement,  response  levels,  effectiveness,  environmental 
impairment,  and  comparisons  among  operators.  In  addition ,  supplementary  measures 
are  identified,  including  observational  analysis,  subjective  assessment,  loading 
tasks,  and  physiological  measures. 

W/L  Cat.  Code:  1. ,  2.2,  3.1,  4.1 
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Folfe.  J.M.,  Chappelow,  J.W. ,  Evans,  R.L.,  Lindsay,  S.J.E.  and  Browning,  A.C. 
Evaluating  measures  of  workload  using  a  flight  simulator.  Proceedings  of  the 
AGARD  C-ort  rence  on  Simulation,  and  Study  of  High  Workload  Operations.  AGARD-- 
CP-146,  April,  1574,  A4-1  -  A4- 13. 

Ihe  paper  describes  an  experiment  in  which  n  flight  im-t.-oment  trainer,  rosunbiing 
a  twin  jet  communications  aircraft,  was  used  to  evaluate  questionnaire,  performance 
and  activity  analysis  measures  of  pilot  workload.  Attempts  were  made  tc  distinguish 
between  the  physical,  perceptual  ar.d  mental  components  of  workload.  For  this 
purpose  th’-ee  flight  plc-is  were  devised,  of  approximately  equal  duration, 
differing  markedly  with  respect  to  the  tl -ee  above  components .  Six  professional 
pilots  flew  each  flight  plan  and  after  landing  completed  questionnaires  to  assess 
the  workload  levels  and  the  task  content.  During  the  flights  video  recordings 
were  made  of  the  pilot's  manual  and  communication  activity.  Perfovrmnc  o  during 
ILS  approaches  inmedietely  before  and  after  the  experimental,  flight  plans  vae 
also  measured.  From  these  measures  it  was  possible  to  obtain  significantly 
different  results  relating  to  th?.  different  flight  plans. 


; 
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Rclfe ,  J.  M.  and  Lindsay,  S.  J.  E.  Flight  deck  environment  and  pilot  workload: 
Biological  measure*  of  workload.  Applied  Ergonomics,  1973,  4,  199-206. 

T'.f  object  of  tbia  paper  Is  to  examine  some  of  the  techniques  that  ere  bein^ 
used  to  ctudy  the  deaenda  of  the  v?rk  situation  upon  the  individual.  While 
the  emphatic  throughout  the  paper  is  on  studies  of  aircrew  workload,  the  findings 
have  a  general  applicability  to  applied  ergonomics. 

W/L  Car.  Coda:  1.,  2.2,  3.1,  3.3,  4.1 

Op.  Behav.  Code:  1. ,  2.,  4. 
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Rosooe ,  A.  H.  Heart  rate  monitoring  of  pilots  during  steep- gradient  approachen. 
Aviation,  Space,  and  Environmental  Medicine.  3975.  46,  1411>~1'*I3. 

As  part  of  a  large  scele  investigation  into  noise  abatement  landing  approaches, 

one  trial  involved  the  flight  evaluation  of  st nap-gradient  snd  twe-segment  approaches ; 

thesa  were  3*',  6°,  7.5°,  and  9°  singlft-segmtnt,  and  7. 5°/ 3°  two-segment  approaches. 

To  augment  the  subjective  opirJLons  o 7  the  test  pilots,  their  heart  rates  were 
monitored  during  all  She  experimenta*  rtc.*/,  The  resulting  heart  rate  values  for 
the  dif Icrwnt  approaches  correlated  reasonably  well  with  the  subjective  ratings 
of  the  relative  workload  levels.  There  it  some  evidence  that  the  pilot  workload 
level  fo  '  the  7. 5°/ 3°  approaches  is  of  Che  same  order  as  the.  level  tor  the 
conventional  3C  -radiant. 

V)/L  Cat.  Code:  1.1,  4.1.10 

Op.  fcenav.  Code*  1.,  2.,  3.,  4. 
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Roscoe,  A.  H.  Pilot  workload  during  steep  gradient  approaches.  Farnhorough, . 
England:  Royal  Aircraft  Establishment,  Flight  Systems  Department,  Technical 
Memorandum  No.  TM  FS  78,  1976. 

A  flight  trial  to  evaluate  different  approach  profiles  and  techniques  using  a 
BAC  VC-10  is  described.  Pilot's  heart  rates  were  measured  which,  together  with 
subjective  opinions,  were  used  to  assess  levels  of  workload.  Moat  of  the 
experimental  approaches  and  landings  were  flown  by  two  test  pilots,  though 
other  pilots  participated  briefly  in  the  trial.  The  types  of  approach 
Investigate^  -»ol  »ded  single  segment  with  gradients  up  to  and  including  6  1/2°, 
5°/3°  two  ,  .i  with  an  intersection  height  of  500  ft,  5°/3°  two  stage 
flares,  an,  >  low  drag  approaches.  Evidence  is  presented  to  show  that  5°/3° 
twe  segment  approaches  do  not  cause  significantly  higher  heirt  rates  thai  do 
convent,  msl  3°  approaches.  In  general,  heart  rate  levels  and  subjective 
estimations  showed  good  agreement,  this  was  especially  so  when  comparing 
workload  levels  generated  by  the  different  profiles  and  techniques.  Results 
seem  to  support  the  contention  that  the  introduction  of  noise  abatement  approaches 
and  landings  need  not  necessarily  cause  an  Increase  in  pilot  workload. 

W/L  Cat.  Code:  1.1,  4.1,10 

Op.  Behav.  Code:  1.,  2.,  4. 
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Roscoe,  A.  H.  Use  of  pilot  heart  rate  measurement  in  flight  evaluation. 

Aviation,  Space  and  Environmental  Medicine.  1976,  .47,  86-90. 

Experimental  test  pilots  involved  in  the  flight  evaluation  of  handling  qualities 
and  systems  were  monitored  for  heart  rate  during  an  investigation  to  assess  the 
possible  use  of  this  measure  to  augment  their  subjective  opinions.  Reference 
Is  made  to  examples  from  several  different  flight  trials  using  a  variety  of  air¬ 
craft  types.  It  i3  concluded  that  pilot  heart  rate  measurement  is  a  worthwhile 
technique  and  can  play  a  useful  part  in  flight  evaluation  provided  that  certain 
limitations  are  recognized. 

W/L  Cat.  Code;  1.1,  4.1.10 
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Roscoe,  A.H.  (Ed.)  Assessing  pilot  workload.  AGARD-AG-233,  February,  1978. 

(AD  A051  587) . 

This  AGARDograph,  written  primarily  for  flight  test  engineers  and  pilots,  is 
Intended  as  a  guide  to  the  different  methods  available  for  estimating  workload  and 
in  particular  to  those  techniques  suitahle  for  use  in  aircraft.  An  introductory 
chapter  reviews  the  various  concepts  and  classifications  of  workload;  the  former 
tend  to  fall  into  two  main  areas,  those  related  to  workload  a3  task-demands  and 
those  to  workload  as  pilot-effort.  In  Chapter  2,  subjective  assessment  is  dis¬ 
cussed  from  the  viewpoint  of  the  test  pilot.  Physiological  methods  in  general  are 
reviewed  In  Chapter  3  with  those  techniques  available  for  use  in  flight  being 
discussed  in  more  detail.  Chapter  A  describes  various  objective  methods  and 
presents  examples  of  their  practical  application.  Whereas  the  :  '>ods  in  Chapters 
2  and  3  are  appropriate  only  to  workload  as  effort,  objective  method  contain 
techniques  appropriate  to  workload  as  task-demands  as  well  as  to  effort.  The 
former  techniques  are  particularly  valuable  for  providing  data  which  can  be  used 
to  construct  models  and  to  predict  levels  of  workload. 

W/L  Cat.  Code:  1.,  2.,  3.,  A. 
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Roscoe,  A.K.  Physiological  methods.  J.n  A.H.  Roscoe  (Ed.)  Assessing  pilot 
workload.  AGARD-AG-233,  February,  1978,  23-51.  (AD  A051  587). 

The  rationale  of  recording  physiological  activity  to  assess  levels  of  pilot 
workload  depends  on  two  assumptions:  (a)  that  an  acceptable  concept  of  workload 
is  the  physical  and  mental  effort  required  to  satisfy  the  demands  of  the  flight 
task,  and  (b)  that  the  level  of  arousal,  as  measured  by  physiological  indices, 
is  related  in  some  way  to  the  amount  of  effort.  Of  the  various  physiological 
indices  heart  rate  has  been  shown  to  be  generally  reliable  for  realistically 
demanding  flight  tasks  and  it  Is  reasonably  easy  to  record  and  to  analyze.  An. 
added  advantage  of  this  measure  is  that  when  displayed  ia  beat-fo-teat  form, 
heart  rate  variability  13  available,  (as  a  bonus)  for  use  as  a  sensitive  indicator 
of  changes  in  mental  load.  Because  of  the  liaitations  inherent  in  using  physio¬ 
logical  measures  to  assess  pilot  workload  there  are  several  pitfalls  for  the  unwary. 
Physiological  treasures  alone  can  be  used  to  estimate  levels  of  workload  and 
especially  to  identify  peaks  and  troughs  in  the  workload  patterns.  However,  they 
a*.e  of  j»re  value  when  used  to  augment  pilot  opinion  and,  therefore,  should  be 
used  in  conjunction  with  s  ’me  form  of  subjective  measure, 

W/L  Cat.  Code:  A. 
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Roscoe,  A.  H.  Stress  and  workload  in  pilots.  Aviation,  Space  and  Environmental 
Medicine,  1978,  49,  630-636. 

Several  studies  have  highlighted  the  increase  in  physiological  activity  which 
occurs  in  pilots  during  flight  and  especially  during  takeoffs  and  landings.  For 
example,  it  has  been  clearly  demonstrated  that  pilots'  heart  rates  Increase  during 
the  landing  approach  to  reach  a  peak  at  or  just  before  touchdown.  These  changes 

have  been  attributed  to  workload  and  to  psychological  or  emotional  stress.  This 

paper  examines  a  number  of  test  pilots'  heart  rate  responses  recorded  during 
various  flight  trials  involving  different  types  of  aircraft.  It  is  concluded 
that  heart  rate  responses  in  experienced  pilots  are  influenced  almost  entirely 
by  workload-related  factors  and  by  clonal  stressors,  such  as  rink  and 
anxiety.  Because  of  the  emotin''  i  ones  of  the  word  'stress',  it.  is 

suggested  that  the  term  workloau  oe  used  when  referring  to  the  reason  for 

increased  cardiovascular  activit>  x  pilots. 
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Roscoe,  A.  H.  Handling  qualities,  workoad,  and  heart  rate.  In  B.  0.  Hartman 
and  R.  E.  McKenrie  (Eds.)  Survey  of  methods  to  assess  workload.  AGARD-AG- 
246,  August,  1979,  83-91. 

Workload  levels  for  a  given  piloting  task  are  related  to  the  aircraft's  handling 
characteristics,  but  a  valid  rating  for  the  latter  may  no  always  give  a  reliable 
estimate  of  workload.  Experienced  test  pilots  may  be  quite  adept  at  using  opinion 
rating  scales,  but  occasionally,  it  seems  difficult  to  separate  assessments  of 
workload  from  those  of  handling  qualities,  leading  to  anomalies  and  ambiguities. 
Westbrook  and  his  colleagues  commented  that:  "If  a  reliable  method  were  available 
to  obtain  a  measure  of  workload  or  stress,  it  is  undeniably  true  that  many  of  the 
anomalies  in  handling  qualities  data  could  be  explained."  Several  investigators 
have  recorded  physiological  variables  from  pilots  in  real  and  simulated  flights 
as  a  means  of  estimating  levels  of  stress  and  workload.  This  paper,  by  describing 
two  current  flight  trials  and  by  referring  briefly  to  previous  studies,  examines 
the  relationship  between  pilot's  heart  rate  and  subjective  assessment  of  handling 
qualities  and  workload. 
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Roscoe,  A.  H.  and  Goodman,  E.  A.  An  investigation  of  heart  rate  changes  during 
a  flight  simulator  approach  and  landing  task.  Farnbcrough,  Hants,  England: 

Royal  Aircraft  Establishment,  RAE-TM-Avionics-lS5,  1973. 

A  blind  landing  simulator  was  used  in  the  fixed-base  mode  to  examine  charges 
in  heart  rate  as  a  function  of  simulator  effectiveness  and  differences  in  the 
various  approach  conditions.  Seventy-five  pilots  did  over  800  runs  to  give  them 
experience  of  approaches  and  landings  in  low  visibility  conditions.  It  ves 
found  that  significant  changes  in  heart  rate  occurred  due  to  simulator  effectiveness 
only. 

W/L  Cat,  Code:  4.1.10 
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Roscoe,  S.  N.  Assessment  of  pilotage  error  in  airborne  area  navigation 
procedures.  Human  Factors,  1974,  l(j,  223-228. 

In  1969,  by  specifically  including  "pilotage  error"  in  the  error  budget  for 
area  navigation  system  certification,  the  Federal  Aviation  Administration 
legally  attached  economic  premiums  and  penalties  to  human,  as  well  as 
equipment,  performance  in  man-machine  system  design,  'fo  establish  the 
accuracy  of  use  and  freedom  from  pilot  blunders  associated  with  systems 
employing  various  configurations  of  displays  and  controls  requires  both 
simulator  and  flight  experimentation.  An  automatically  adaptive  cockpit 
side  task  provides  a  saturating  level  of  pilot  workload  and  allows  the 
sensitive,  orderly,  and  statistically  reliable  measurement  of  &  pilot's 
residual  attention  as  a  common  metric  for  area  navigation  system  assessment. 

W/I.  tat.  Code:  2.2.4,  3-1 

Cp.  Behav.  Code:  2.1,  4.2 
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Rosenbrock,  F.  Hardware  problems  In  ergonomics  measurements.  Ergonomics , 

1971,  14,  617-623. 

The  most  difficult  problem  in  analyzing  man-machine  systems  is  the  cssesoment 
of  the  operator’s  vorkload.  The  methodological  difficulties  are  evident 
because  of  the  human  complexity  and  the  necessity  of  avoiding  any  interference 
in  the  work  situation.  These  problems,  especially  the  great  number  of  data 
needed,  necessitate,  new  concepts  in  ergonomics  measurements .  By  using  an 
actual  problem,  the  analysis  of  the  task  and  workload  of  radar  controllers 
the  application  of  multichannel  automatic  data  acquisition  and  processing 
is  demonstrated.  For  assessing  strain,  advantage  is  taken  of  die  physiological 
variables:  electro-cardiogram  (FCG) ,  electro-oculogram  (EOC)  in  both  directions, 
electro-myogram  (EMG)  of  a  back  muscle  and  xesplrutio.r.  To  correlate  these 
variables  with  factors  of  stress  and  strain  »■  coding  is  described,  which 
renders  the  evaluation  of.  a  multi-dimer rional  work  process  study  automat:  ally 
and  synchronously  with  the  physiological  data. 

W/L  Cat.  Code:  4.1.3,  4  1.4,  4.1.5,  4.1.11 
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Sotondo,  G.  Workload  and  operational  fatigue  ir»  helicopter  pilots. 

AviationT  Space,  and  Environmental  Medicine.  1978,  J49,  430-436. 

A  brief  review  is  presented  concerning  possible  causes  of  operational  fatigue  to 
which  flying  personnel  in  general  are  exposed  in  the  exercise  of  flying  activity. 

The  paper  then  describes  and  analyses  the  meaning  and  importance  of  the  various 
stressing  factors  that  constitute  the  physical  and  psychic  workload  to  which  the 
helicopter  pilot  is  subjected  in  performing  his  professional  activities.  Also 
analyzed  are  the  influences  exercised,  both  separately  and  Jointly,  on  the  genesis 
of  flight  fatigue  in  helicopter  pilots  by  stressing  and  fatiguing  effects  of 
vibrations,  noise  end  psvcho-emotior.rl  and  psycho-senorial  factors  related  to  the 
variety  end  danger  of  utilization  of  this  modern  aircraft.  Such  an  analytical 
investigation  indicates  that  helicopter  piloting  involves  a  psycho-physical  workload 
certainly  no  Jess  than  that  required  by  more  powerful  and  faster  aircraft. 
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Rouse,  W.  B.  Humar.-compuler  interaction  in  multitask  sitv  ions.  IEEE 
Transactions  on  Systems.  Man,  and  Cybernetics,  1977,  SMC  7.  384-392. 

Human-computer  interaction  in  multitask  decisionmaking  situation*,  is  considered, 
and  it  is  proposed  that  humans  and  computers  have  overlapping  responsibilities. 
Queueing  theory  is  employed  to  model  this  dynamic  approach  to  the  allocation  of 
responsibility  between  human  and  compute-.  Results  of  simulation  experiments 
are  used  to  illustrate  the  effects  of  several  3ystera  variables  including 
number  of  tasks,  mean  time  between  arrivals  of  act ion -evoking  events,  human- 
coEputer  speed  mismatch,  probability  of  coiputer  error,  probability  of  human 
error,  and  the  level  of  feedback  between  human  and  computer.  Current 
experimental  efforts  are  discussed  and  the  practical  issues  involved  in 
designing  hu>aan-computer  systems  for  multitask  situations  are  considered. 

W/L  Cat.  Code:  3.3 

Op.  3ehav.  Cods:  1. ,  2. ,  4.  ^ 

Primary  task  Math  model  Const iucc  Laboratory  Flight  simulator 

Experimental 


Rouse,  W.E.  Approaches  to  mental  workload.  In  N.  Moray  (Ed.)  Mental  workload: 

Its  theory  and  measurement.  New  York:  Plenum  Press.  1979,  235-262. 

This  paper  addresses  the  issues  involved  in  defining,  predicting,  and  measuring 
mental  workload.  It  has  been  argued  tha'.  fraction  of  attention  and  intensity 
of  effort  are  the  essential  components  jf  mental  workload.  An  approach 
utilizing  queueing  models  and  utility  junctions  has  been  suggested.  The 
difficult  issues  considered  include,  measurement  of  intensity  of  effort  us  well 
as  inter-task  and  Inter- individual  comparisons.  Also,  it  is  noted  that, 
development  of  ether  than  an  ordinal  scale  of  mental  workload  may  prove: 
difficult. 

W/L  Cat.  Code:  1.1,  3.1,  3.3,  4.1 

Op .  Bthav .  Code :  1 . ,  2 . ,  3 . ,  4 . 

Opinion  Multiple  Construct  None  Flight  simulator 

Primary  task 

Physiological 


1 

1 

i 
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Sanders,  A.F.  Some  remarks  on  mental  load.  In  N.  Moruy  (Ed.)  Mental  workload: 

Its  theory  and  measurement.  New  York:  Plenum  Press,  1979,  41-77. 

This  paper  presents  an  analysis  of  the  concept  of  mental  lead  from  the  point  of 
view  of  num&A  performance  theory.  In  the  first  section  the  theoretical  status 
of  the  concept  of  mental  load  is  considered.  It  is  concluded  that  it  is  based 
upon  common  sense,  which  lannot  be  empirically  founded  In  a  simple  way.  Then  an 
outline  is  given  of  the  main  procedures  of  measurement.  The  next  section  describes 
a  number  of  theoretical  bisej  which  are  all  related  to  some  kind  of  limited 

capacity  notion.  It  is  concluded  that  the  original  leys  of  channel  capacity  in 

terms  of  information  theory  fails  to  provide  a  sound  theoretical  framework.  Other 
capacity  concepts  in  terms  of  limited  capacity  proesssois  and  in  terms  of  effort 
ere  described.  Three  types  of  processors  are  distinguished,  which  have  different 
consequences  for  the  measurement  of  mental  load.  The  fourth  section  describes 
experimental  trends.  It  is  concluded  that  a  multichannel  type  of  processor, 
composed  of  a  network  of  internal  mechanisms  is  most  favored  by  the  data. 

* 

V/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiple  Review  None  Flight,  simulator 

Spare  m.  capacity  Construe' 

Primary  task 
Physiological 


Sanders,  M.G. ,  Burden,  R.  T. ,  Jr.,  Simmons,  Rs  R.  ,  Lees,  M.  A.,  and  Kimball,  K.  A. 
An  evaluation  of  perceptual-motor  workload  during  a  helicopter  hover  maneuver. 
Ft.  Rucker,  Alabama:  U.S.  Army  Aeromedical  Research  Laboratory,  78-14, 

May,  1978. 

The  current  research  project  examines  a  method  of  aiding  the  MEDEVAC  pilot  in 
performing  a  hover  maneuver  while  perhaps  reducing  workload.  A  modular,  four- 
axis  stability  augmentation  system  *  linistab)  with  integrated  rate  attitude  and 
heading  retention  was  installed  on  the  USAARL  JUH-1H  helicopter.  Participating 
personnel  for  the  project  were  nine  UC  Army  aviators  with  a  total  average  of 
1172  flight  hours.  The  aviatora  hovered  at  30  feet  above  ground  level  for  five 
minutes  under  each  of  the  three  following  flight  control  conditions:  (1)  Unaided — 
"normal"  hover  with  visual  flight  rules  conditions,  (2)  using  Force  Trim,  and  (3) 
using  the  Ministab.  Continuous  information  from  twenty  pilot  and  aircraft 
monitoring  points  was  recorded  on  an  incremental  digital  recorder  for  all  flights. 
Multivariate  analyses  were  performed  on  both  aircraft  status  variables  and  control 
input  workload/activity  measures.  Under  the  conditions  tested,  the  stability 
augmentation  system  evaluated  did  not  provide  a  clear-cut  improvement  in  flight 
performance  and  workload  across  all  flight  parameters. 

W/L  Cat.  Code:  1.1,  3.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  test  Flight  simulator 

Primary  task  Multiple  measures  Flight  test 
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Sanders,  M.  G. ,  Simmons,  R.  R. ,  and  Hofmann,  M.  A.  Visual  workload  of  the 
copllot/navlgator  during  terrain  flight.  Human  Factors,  1979,  21,  369-383. 

The  visual  workload  of  the  navigator/copilot  during  terrain  flight  in  a  UH-1H 
helicopter  is  investigated.  Ocuj.oniot.cr  performance  during  nap  of  the  earth, 
contour  and  low  level  flight  was  recorded  by  a  modified  NAC  Eye  Mark  Recorder  in 
conjunction  with  8  16  an  high  speed  motion  picture  camera.  Data  indicate  little 
variation  between  time  spent  at  each,  visual  area  for  different  flight  tasks. 
Visual  cues  needed  for  navigation  were  primarily  obtained  from  terrain  viewed 
from  the  copilot's  windscreen,  with  frequent  reference  to  the  handheld  map.  It 
is  found  that  the  duty  of  navigating  required  92. 2X  of  the  copilot's  visual  time, 
while  the  engine  and  flight  instruments  were  utilized  only  4. OX  of  th«  time;  a 
visual  free  time  task  was  utilized  only  3X  of  the  time,  mostly  during  hover 
periods. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Physiological 


4.1.7 

1.,  2. 

Eye  movement 


Experimental  Flight  test 


Flight  simulator 
Flight  test 


Sanders,  M.  G. ,  Simmons,  R.  R. ,  Hofmann,  M.  A.  and  DeBonis,  J.  N.  Visual 
workload  of  the  copilot /navigator  during  terrain  flight.  Proceedings  of 
the  Human  Factors  Twenty-First  Annual  Meeting.  San  Francisco,  Calif.: 

Human  Factors  Society,  October  1977,  262-266. 

The  emphasis  on  aviator  workload  has  been  of  primary  concern  to  the  US  Army 
aviation  conmunlty  since  the  incorporation  of  low  altitude  terrain  flight 
techniques  into  the  helicopter  tactics  repertory.  Since  aviation  har  been 
a  particularly  acute  problem  at  low  altitudes,  this  project  examined  the 
visual  workload  of  the  navigator/copilot  during  terrain  flight  (r.ao-of-the- 
earth,  contour  and  low  level)  in  a  UH-1H  helicopter.  Visual  performance 
was  measured  via  a  modified  NAC  Eye  Mark  Recorder  used  in  conjunction  with  a 
LO-CAM  high  speed  camera.  This  technique  provided  the  means  to  objectively 
record  and  analyze  the  navigator's  visual  performance  through  the  examination 
of:  (1)  visual  time  inside  the  cockpit  of  flight  and  engine  Instruments,  (2) 
time  inside  the  cockpit  on  the  map  or  other  navigation  aids,  and  (3)  time 
outside  the  cockpit  in  various  windscreen  sectors. 

W/L  Cat.  Code:  2.2.1,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  test  Flight  simulator 

Physiological  Eye  movement  Flight  test 
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Sanders,  M.  S. ,  Jankovich,  J.  J.  and  Goodpaster,  P.  R.  Task  analysis  for  the 
jobs  of  train  conductor  and  brakeman.  Crane,  Indiana:  Naval  Ammunition 
Depot,  RPTR-No.  263,  July,  1974. 

This  report  identifies  and  describe*  the  principal  tasks  performed  by 
conductors,  rear  brakemen,  and  head  brakemen  during  over-the-road  freight 
operations  utilizing  diesel-electric  locomotive  equipment.  Forty-four 
tasks  and  subtasks  were  analyzed  and  grouped  into  six  categories:  basic 
handling  tasks,  pre-run  preparation  and  starting  off  tasks,  over  the  road 
tasks,  terminating  tasks,  operating  emergency  and  malfunction  tasks,  and 
auxiliary  equipment  operating  tasks.  Bach  task  or  subtask  is  described 
from  a  system’s  perspective.  The  descriptions  depict  the  tasks'  initiating 
stimuli,  the  information  processing  and  decision  making,  the  response  made 
by  the  operator  and  the  feedback  received.  The  tasks  are  also  analyzed  to 
determine  task  difficulty,  potential  hazards  and  the  criticality  of  each 
task.  The  task  descriptions  are  translated  into  operational  sequence 
diagrams  with  additional  information  given  concerning  the  decisions  depicted 
on  each  operational  sequence  diagram. 

W/L  Cat.  Code:  2.1.1 

Op.  Be'nav.  Code:  2.,  4. 

Spare  m.  capacity  Task  comp. ,  Construct  Nona  Flight  simulator 

time  assess. 


Savage,  R.  E. ,  Wierwille.  W.  W.  and  Cordes ,  R.  E.  Evaluating  the  sensitivity 
of  various  measures  of  operator  workioad  using  random  digits  at.  a  secondary 
task.  Human  Factors,  1973,  20,  649-654. 

Problems  have  been  encountered  in  previous  research  in  developing  a  necondary 
task  measure  of  mental  workload  that  is  both  sensitive  and  stable.  Ordinarily 
a  single  measure  of  secondary  task  is  analyzed  as  an  Indicator  of  difference 
in  workload.  The  purpose  of  the  experiment  reported  here  was  to  determine 
whether  alternate  measures  taker,  from  a  single  secondary  task  might  prove  more 
sensitive.  Twelve  subjects  participated  in  the  experiment  involving  a  primary 
task  (meter  pointer  nulling)  and  a  secondary  task  (reading  random  digits  aloud) . 
The  independent  variable  (primary  task  difficulty  level)  was  adjusted  by 
changing  the  number  of  meters  that  had  to  be  monitored  (two,  three,  or  four 
meters) .  Dependent  measures  were  taken  on  the  (1)  number  of  random  digits 
spoken  (usual  workload  formula),  (2)  longest  interval  between  spoken  responses, 
(3)  longest  consecutive  string  of  spoken  digits,  and  (4)  the  number  of  "triplets" 
spoken.  Results  show  that  the  dependent  measures  (1) ,  (3) ,  and  (4)  were 
significant  with  (1)  fcaing  the  most  sensitive. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  1. ,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 

Flight  test 


2.53 
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Sayers,  &.  M.  Aualyaia  of  heart  rata  variability.  Ergonomics,  1973,  16, 

17-32. 

Spontaneous  variability  of  naart-rate  haa  been  related  to  three  major  physiological 
originating  factors:  quaai-oscillr.tory  fluctuations  thought  to  arise  iu  blocd- 
praasure  control,  variable  frequency  oscillations  due  to  thermal  regulation,  and 
respiration;  frequency  salectivo  ennlyeis  of  cardlec  interbeat  interval  ecquon.es 
allows  the  supe.ato  contributions  to  be  isolated.  Using  this  method,  a  laboratory' 
and  field  study  of  the  effects  of  mental  work  load  on  tho  cardiac  interval 
sequence  haa  been  carried  out.  Reaulta  suggest  that  mean  heart  rate  and  variance 
are  unreliable  moaautae,  hut  that  conaiatant  changes  in  interval  spectrum  occur; 
these  have  been  traced  to  alterations  maimy  in  the  0.1  He  region,  perhaps 
originating  with  changes  in  the  patterns  of  inspiration  which  interact  with  the 
0.1  Hs  vasomotor  activity. 

W/L  Cut.  Code:  4.1.10,  4.1.11 

Op.  Behav.  Code:  2. 

.’hysioicgical  Heart  rate,  Review  Laboratory  Flight  simulator 

h.t.  var. 

breathing  an*i.  Construct  Field  Flight  teat 

experimental 


Schick ,  F.  V.  Or.  the  practical  utility  of  critical  flicker  fusion  frequency 
measurements  to  the  asset. ment  of  mental  wort  load.  Rreunsweig,  West  Germany: 
Institute  fur  Flugfuhrung,  Report  DLF-FB  /o-b7,  19*6.  (In  German). 

(Available  in  English  ns  European  Spam  Agency  translation  ESA-TT-?98-R«vised, 
November,  1977.) 

Twe  experiments  wer*  conducted  to  evaluate  the  utility  of  an  advanced  measuring 
device,  coupled  with  a  practicable  measurement  procedure,  with  respect  to  reliable 
and  valid  assessment  of  mental  workload  by  measuring  critical  flicker  fusion 
frequency  (OFF),  in  the  first  experimt..^ ,  basic  variability  of  OFF  scores, 
obtained  under  nonworkload  conations,  was  studied.  Error  of  ifuasuretsient  as  veil 
as  physical  and  physical  interference  variables  wen  discussed  to  be  sources  of  tho 
t arg-J  oscillations  actually  ob  .served  from  data,  it  was  found  necessary  to  modify 
ch«  Dt?«taure.!ivnt  procedure.  In  the  second  experiment  CFF  thresholds  ware  exatainoa 
Statistical  analysis  tevociod  generally  low  reliability  co*»ff lcisnta.  Also 
thresholds  failed  to  diacr iminate  between  low  workload  and  hljth  workload  treetuwjnta . 


W/L  CAt.  Code: 

>.).  4.1.1 

Op.  Behav.  Code: 

* »  2 »  *  4  . 

•’virnary  cawx 

Single  measures? 

!  xperi mental  Laboratory 

Background 

Ph.yv.ii.'  'gicai 

FF1 
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Schiffler,  R.  J. ,  Geiselhart,  R.,  and  Griffin,  J.  C.  h  study  of  ciew  taBk 
loading  on  the  C-141  aircraft.  Wrig'ht-Patterson  Air  Force  Base,  Ohio: 

Air  Force  Systems  Command,  ASD-TR-78-3,  April,  1978.  (AD  AC57  346). 

At  the  request  of  the  Military  Airlift  Command,  human  factors  engineers  participated 
in  a  C-141  crew  composition  and  task  load  analysis.  The  objective  of  the  study 
was  to  determine  the  feasibility  of  a  four-man  crew  consisting  of  two  pilots,  a 
flight  engineer  and  a  flight  system  operator,  to  fly  C-141  missions.  The  test 
results  indicated  that  the  air/land  mission  can  be  accomplished  with  a  four-man 
crew.  Presently  for  a  combat  airlift  mission  (airdrop)  the  most  optimal  crew 
composition  would  be  two  pilots,  navigator  and  flight  engineer.  With  additional 
training,  it  might  be  feasible  to  substitute  c  flight  system  operator  for 
navigator  in  the  combat  airlift  mission. 


\i/L  Cat.  Code: 

2.1.1,  3.1 

Op.  Behav.  Code: 

1. ,  2.  ,  3. ,  4 . 

Spare  m.  capacity 

Task  comp..  Experimental 

Flight  t^st  Flight 

simulator 

time  assess. 

Primary  task 

Single  mesfurr.s 

Flight 

test 

Schiffler,  R.  J.,  Geiselhart,  R.  and  Ivey,  L.  Crew  composition  study  for  an 
Advar.ctd  Tanker /Cargo  Aircraft  (ATCA)  .  Wright-Pattsrson,  AFB,  Ohio:  USAF 
Aeronautical  Systems  Division,  ASD-TR-76-20 ,  October,  1976. 

To  determine  the  minimum  crew  complement  reovir^d  for  an  Advanced  Tanker/Cargo 
Aircraft  a  series  of  contractor  and  Af  task  analyses  were  reviewed  and  evaluated. 
Coupled  with  these  analysec  were  a  scries  cf  flight  tests  which  verified  some 
of  the  task  times  and  procedures  required  for  Advanced  Tanker/Cargo  Aircraft. 

It  was  concluded  that  a  three  man  crew  (P,  CP,  Boom  Operator)  had  crew  work 
overloads  during  several  flight:  segments  and  this  ertw  size  would  be  unacceptable 
ir.  a  Emergency  War  Order  (EVO)  en\  ronnent.  A  four  man  crew  (P,  CP,  N/FE  and 
Boom  Operator)  was  the  most  advantageous  and  could  handle  most  tasks  below  a 
100%  task  loading. 

Vf r'L  Cat.  Code:  2-i.i 

Op.  Sehav.  Code:  2.,  3.,  4. 

Spare  m.  capacity  Tastt  comp. ,  Construct  Laboratory  Flight  simulator 

time  assess. 

Primary  task  Single  measures  Experi-  Flight  test 

mental 
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Schlflett,  S.G.  Operator  workload-'  An  aunotated  bibliography.  Patuxent 
River,  Maryland:  US  Naval  Air  Test  Center,  S7-257R-76,  December,  197b. 

The  importance  of  maintaining  optical  aircrew  workload  levele  has  long  been 
recognized  as  a  significant  factor  that  contributes  to  the  overall  success  or 
failure  of  u  mission.  Workload  as  traditionally  defined  in  thu  context  of  crew 
work- rest  schedules  or  time- end-motion  studies  are  typically  mnanurod  by  "amount 
of  expended  physical  effort”  or  "time  analysis  of  activities. •’  However,  these 
types  of  approaches  nave  the  same  methodological  problems  as  some  of  the  more 
modern  techniques  of  measuring  workload,  e.g.,  man- simulation  models,  because 
they  were  not  developed  for  the  test  and  evaluation  environment  and,  consequently, 
were  derived  from  an  inadequate  and  inappropriate  data  bane.  The  purpose  cf  this 
study  wac  to  compile  an  anrotative  bihliograjhv  of  methodologies  thac  measure 
operator  workload  in  aircrew  systems.  This  compilation,  is  necessary  to  meet 
the  need  for  a  continuing  review  of  test  and  evaluation  methodology. 

W t'L  Cat.  Code:  1.,  2.,  3.,  4 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Opinion  Multiple 

Review 

None 

Flight  sjjnulator 

Spare  m.  capacity 

Flight,  test 

Primary  task 

Physiological 

Schlflett,  S  0.  Voice  stress  analysis  as  a  measure  of  operator  voixload. 
Proceedings  of  the  23rd  Annual  Meeting  of  the  Human  Factors  Cscicty,  Boston, 
Massachusetts,  October  29-«ovtmbet  1,  1979,  573. 


A  need  exists  for  a  general  stress  measure  which  is  nonobtrusive  and  can  be 
applied  in  actual  operational  circumstances  wJrnout  interfering  with  operator 
performance.  Previous  research  in  the  field  of  voice  analysis  has  indicated  thfct 
the  psychophysiological  stress-state  of  the  speaker  may  manifest  itself  in  the 
acoustic  domain  by  changes  in  tne  frequency  modulation  (8  to  12  Hz)  of  the  fundo- 
uientai  frequency  (50  to  250  Hz)  of  the  voice.  This  study  attempted  to  determine 
if  such  frequency  modulation  changes  can  be  used  to  detect  the  amount  of  situational 
stress  in  the  voice  while  subjects  performed  a  four-choice  information  processing 
task  at  different  presentation  rates.  A  Response  Analysis  Tester  (RATER)  presented 
a  four-chcice  discrimination  task  in  which  each  subject  was  required  to  match  a 
response,  key  to  each  of  four  stimuli  (numbers  -or.e,  two,  three,  and  four)  appearing 
in  a  display  window.  The  voice  was  analyzed  by  a  device  manufactured  by  Oektor, 
Incorporated,  called  a  Psychological  Stress  Evaluator  (?SE) ,  developed  specifically 
as  a  deception-detection  instrument.  Preliminary  voice  stress  analyses  for  15 
subjects  show  correlations  between  performance  scores  and  stress  ratings.  The 
results  are  discussed  as  to  the  potential  application  for  a  nonobtrusive  measure 
of  stress  in  vocal  communication  systems  that  require  operrtor  workload  assecuments. 

W/L  Cat.  Code:  4.3 

Op.  Behav.  Cede:  1.,  3.,  4.1 


Ph/siologica.i 


Speech  pat;, 
anal. 


Experimental  Laboratory  Flight  simulator 

Flight  test 
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Sohlflatt,  3.  O.  Evaluation a  pitot  workload  assessment  device  to  test  alternate 
display  - orauts  and  control  stability  variations.  Patuxent  River,  Maryland; 

Naval  Air  Teat  Center ,  SY-33R-80,  February  1980- 

Thij  inflight  research  project  evaluated  tha  utility  of  <t  Workload  Assessment 
Devioe  (WAD)  to  me  ~urc  pilot  workload  for  approach  ami  landing  tasks  under 
simulated  Instrument  meterologioal  conditions,  alternate  Head-up  Display  (HUD) 
formats,  and  control  stability  variations.  The  flight  cesta  were  conducted 
in  an  NT-33A  resea-ch  aircraft,  extensively  modified  r or  the  Air  For^e  and  Navy 
by  the  Display  Evaluation  Flight  Test  Program.  The  hr.  dware,  software,  and 
tsat  procedures  associated  with  the  WAD  f’lnetionod  efficiently  with  only  minor 
discrepancies  and  minimum  pilot  distraction.  The  project  established  the  feasi¬ 
bility  of  using  an  item  recognition  task  as  a  measure  of  sensory-response  load¬ 
ing  and  reserve  information  processing  capacity  while  flying  precision  approaches. 
T.ib  rt.  alts  indicate  sn  appreciable  Increase  in  reaction  time  and  errors  on 
the  secondary  task  flown  with  degraded  handling  qualities  as  compared  to  ground 
baseline  measures  and  good  handling  qualities.  The  pilots  showed  more  mental 
reserve  rapacity  when  flying  pictorlal/symboUe  HUD  configurations  as  compared 
to  conventional  HUD  formats  with  standard  scales  and  alph -mwerics.  It  is  ruo- 
onmended  that  furthe>~  evaluations  be  conducted  to  establish  the  efficacy  cf 
utilising  tne  WAD  to  measure  mental  workload  in  a  wide  variaty  of  aircrew  tasks. 


W/L  Cat.  Code;  1.1,  2.2.1 

Op,  Behav.  Code:  1.,  2.,  4. 


Opirdon  Rating  scales  Experimental 

Spare  M.  capaoity  Secondary  taak 


Flight  test  Flight  simulator 
Flight  test 


Schiflett,  15.  G.  and  Loikith,  G.  J.  Voice  3tress  us  a  measure  of  opiiratov 
wcxfcload,  Patuxent:  River,  Maryland;  Naval  Air  Test  Center,  Technical 
Memorandum  TM79-3  SY,  December  31,  1979. 


Thi*  piper  documents  a  study  that  attempted  to  determine  if  the  PSE  could  be 
used  to  detect  the  amount  of  situational  stress  in  the  voice  while  subjects 
performed  a  four-choice  information  processing  task  at  different  presentation 
rates.  Ti.e  purpose  wee  to  evaluate  the  relationship  between  performance  scores 
eelf< rated  stress,  and  measured  vocal  stress  due  tc  Increases  in  presentation 
rates.  Voice  stieus  analysis  showed  significant  correlations  with  performance 
scores  and  stiess  ratings  of  a  selected  pool  of  subjects  (N«12).  The  results 
are  ltacus«ed  us  to  the  potential  application  of  ar.  objective,  reliable,  and 
nonobstrualve  aeasura  ot  stress  in  vocal  communication  systems  that  require 
operator  'uorkln.id  assessmurrs. 

W/L  Cat,  Code: 

Op.  Ffthav.  Code; 

Opinion 
Primary  .'•ask 
Physiological 


1.1,  3.1,  4.3 
l,.  2  ,  3.,  4.1 

Rating  scale  Experimental  Laboratory  Flight  simulator 
Single  measures  Flight  tnbt 

Spoech  part, 
anal. 
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Schmidt,  D.  K.  On  modeling  ATC  vork  load  and  sector  edacity.  Journal  of 
Aircraft,  1976,  13  v  531-537. 

This  paper  describes  a  semi -empirical ,  deterministic  x  ork  load  model  and  a  pro¬ 
cedure  intended  to  aid  in  the  design  and  evaluation  of  those  units  of  airspace 
(sectors)  under  the  jurisdiction  of  a  team  of  air  traffic  controllers.  The 
technique  rebates  the  traffic  variables,  route  and  sector  geometry,  and  control 
procedures  to  an  index  that  quantifies  the  vork  load  required  on  the  part  of  the 
air  traffic  control  (ATC)  team.  Work  load,  is  considered  tc  constitute  the  required 
rector  evaluation  criterion  when  maximum  overall  ATC  facility  capacity  and  manning 
efficiency  are  desired.  Willi  proper  calibration,  the  model  may  be  used  to  assess 
Che  impact  o.i  work  load  ar.d  sector  capacity  of  future  automation  features.  An 
example  evaluation  of  an  actual  high  altitude,  enroute  sector  is  included. 

W/L  Cat.  Code:  3.3 

C;p .  Benav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Mrth.  model  Construct  Hone  Flight  simulator 


Schmidt,  D.  K.  A  Queueing  analysis  of  <  he  air  traffic  controllers  work  loud. 

IEEE  Transactions  on  Systems,  Man  and  Cybernetics,  1978,  SMC-8,  492-498. 

The  qualitative  relations  between  workload  measures  (or  stressors),  strain, 
fatigue,  and  the  performance  of  tl  ^  man  in  the  air  traffic  control  (ATC<?  ays tew 
are  reviewed.  A  'irche**  of  stressors,  including  the  workload  magnitude  (i  e., 
minimum  utiIi.zat.ior  time  p«r  unit  time),  dr  la/  in  ATt,  task  execution  due  to 
excessive  activity,  and  mental  image  updating  requirements  are  identified  end 
Jisoutned .  With  the  various  ATC  tasks  competing  for  the  man's  informat ion- 
proeaasing  activity,  a  queuing  model  is  presented.  Calibrated  with  field  data, 
a  computer  simulation  of  the  model  waa  used  to  oot&ia  trends  in  the  above  atreeaors 
versus  traffic  demand  for  two  enroute  sectors.  Preliminary  estimates  of  uariimura 
allouaole  thresholds  for  these  stressors  are  used  to  infer  the  controller 'u 
traffic-handling  capacities. 

W/L  Cat.  Code:  2:.  1.1,  3.3 

Op.  Eehav.  Code:  1.,  2.,  3.,  U  1 

Spare  m.  c/pocltv  Task  comp.. 

time  assess. 

Primary  task  Math,  model 


Construct  Field  Flight  simulator 

Cxnerimertal 
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I  choii,  X.  R.  A  comparison  of  visual,  auditory,  and  cutanwus  tracking 
displays  when  divided  attention  1b  required  To  a  crogs-adeptive  loading 
task.  Zraonomlcs,  1973,  16,  153-158. 

Tho  yree'tnt  Investigation  was  designed  to  order  the  relative  difficulty  of 
tracking  with  a  visual,  an  auditory  and  a  cutaneouc  display.  Utilizing  one 
of  the  three  display*,  subjects  were  required  to  track  while  simultaneously 
performing  a  visual  loading  task.  Tracking  performance  did  not  differ  as  a 
^unc.tinn  of  the  type  of  tracking  display  utilized.  However,  perforjaarce  on 
the  loading  teak  accompanying  visual  and  auditory  trackirg  was  superior  to 
that  accompanying  cutaneous  tracking.  From  these  findings  it  was  concluded 
th.it  visual  and  auditory  tracking  ere  less  difficult  than  cutaneous  tracking 
in  ii:8t  both  the  farmer  lea”*  tne  operator  with  more  "spare  attention"  for 
carrying  additional  tasks. 

W/L  Cat.  Code:  7.2.4,  2,2,5,  3.1 

Op.  Bahav.  Code:  1.,  2.,  3.,  4. 

Spare  r..  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


S’-hori,  T.  ft.  and  Jones,  B.  W.  Smoking  and  work  load.  Journal  of  Motor 
Behavior.  1975,  7,  113-120  - . ~ 

Smokers,  smokers  deprived,  and  nonsmokers  performed  a  compensatory  tracking 
cask  while  simultaneously  performing  a  cross-adaptive  loading  task.  By 
means  of  the  cross-adaptive  technique,  the  size  of  the  subject's  total 
work  load  (tracking  and  loading  tasks  combined)  was  individually  tailored 
to  utilize  inch  subject 'c  entire  attentional  capacity.  No  differences 
were  detected  as  u  function  of  smoking  condition  either  in  tracking  or 
loading  task  performance,  and  it  was  concluded  that  smoking  condition  did 
not  affect  the  size  of  the  workload  which  could  be  handled.  Performance 
generally  improved  with  trials,  however,  none  of  the  smoking  condition  x 
trials  interactions  was  significant,  indicating  that  performance  changes 
with  nractice  did  not  differ  among  the  various  smoking  conditions. 

W/L  Cat.  Code:  2.2.4,  2.2.5 

Op.  Behav.  Code:  1.,  2.,  3.,  4 

Spare  o.  capacity  Subsidiary  task  Experimental  Laboratory  Background 
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Schouten.  J.F.,  Kalsbeek,  J.W.H.,  and  Leopold,  F.F.  Or.  the  evaluation  of 
perceptual  and  mental  load.  Ergonomics .  1962,  5,  2'Jl-260. 

Human  labor  oav  roughly  be  divided  Into  three  different  categories:  physical, 
perceptual  and  mental.  Physical  labor  can  be  measured  in  terms  of  physical  units 
of  consumption  and  production  of  energy.  Physical  labor  is  the  only  kind,  as  yet, 
which  can  be  expressed  in  adequate  units  of  labor.  Perceptual  labor  erd  load 
seem  to  lay  themselves  open  to  interpretation  in  terms  of  such  concepts  as 
information  and  manipulation  similar  to  those  used  in  communication  theory,  rhis, 
however,  could  at  best  apply  to  relatively  simple  patterns  of  stimuli  and  reactions. 
Although,  in  a  general  wey,  the  manifold  perceptual  faculties  art  limited  in  spend, 
accuracy,  extension  and  complexity,  it  is  not  known  whether  these  faculties  lend 
themselves  to  being  expressed  in  terms  of  a  universal  unit,  permitting  of  the 
relative  calibration  of  the  load  of  a  perceptual  task.  Mental  labor  and  load 
might  be  rubricated  in  terms  of  such  concepts  as  attention,  vigilance,  motivation, 
responsibility,  perseverance,  stress,  strategy,  tactics,  etc. 

W/L  Cat.  Cede:  1.,  2.,  3.,  4 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiple  Review  hone  Flight  simulator 

Spare  m.  capacity 
Primary  task 
Physiological 


Schultz,  W.  C. ,  Newell,  F.  D.  and  Whitbeck,  R.  F.  A  study  of  relationships 
hetveen  aircraft  system  performance  and  pilot  ratings.  Proceedings  of  the 
6th  Annual  NASA-University  Conference  on  Manual  Control,  Wright-Pat terson 
AFB,  Ohio,  April  7'-3,  1970,  339-340. 


This  study  examines  the  relationship  between  man-machine  system  performance 
and  pilot  evaluation  data.  Thr  intent  of  the  experiment  described  herein 
is  to  add  to  the  library  cf  knowledge  concerning  quantitative  analytical 
measures  of  pilot-aircraft  performance  for  complex  piloting  tanks  including 
use  of  glideslope  and  localizer  for  ILS  tasks.  The  Cooper-Harper  rating 
scale  was  used. 

W/L  Cat.  Code:  1.1,  3.3 


Op.  Behav.  Code:  1.1,  1.2,  4.2 

Opinion  Rating  scale  Experimental 

Primary  task  Math,  model 


Flight  simulator  Flight  simulator 

Flight  test 
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Cchvaneveldt,  R.  W.  tffercs  of  complexity  in  simultaneous  reaction  time  teaks. 

Journal  of  Experimentel  Psychology,  1965,  jtt,  285-296. 

Two  experiments  investigated  tlw»  effects  of  inforraetion  load  (number  of  alternatives) 
and  S-R  code  in  each  of  two  simultaneous*;-  performed  reaction  time  (RT)  tasks.  The 
subjects  were  required  to  make  both  a  verbal  and  a  manual  response  on  each  trial 
in  the  simultaneous-i-erformance  conditions.  Each  task  was  rtso  performed  alone 
for  -jomparison.  The  results  were:  (a)  fn  simultaneous  performance,  RT  in  each 
task  was  greater  with  more  alternative*  or  an  indirect  S-R  code  in  either  task; 

(b)  the  complexity  of  Che  verbal  tae'<  had  a  smaller  effect  on  verbal  RT  when  the 
complexity  of  the  manual  task  was  increased;  and  (c)  details  of  the  data  argued 
against  a  response-grouping  iuto.-pretation.  The  evidence  for  overlap  between  the 
two  tasks  has  important  implies tion&  for  the  single-channel  hypothesis. 


V/L  Cat.  Cod*: 


2.2.1, 


Op.  Behav.  Cone:  1.,  2.,  3.,  4.1 

b'jrare  j,  capacity  Subsidiary  task  Experimental  Laboratory  Background 


Primary  task 


Single  measures 


ttchwara,  J.  .T.  and  Ekkers,  C.  L.  Estimation  of  task  loading  by  observing 
and  regulating  complex  technical  systems.  Hens  en  Cndernemlug ,  1976, 

76,  85-108.  (In  Dutch).  '  ' 

The  increasing  use  of  complex  automated  technical  systems  leads  to  higher 
rluks  for  people  in  and  outside  these  *  /stems.  Of  crucial  importance  in 
this  respect  is  the  control  task  of  t  i.e  human  operator.  It  is  proposed 
that  task  performance  will  diminish  when  the  task  load  tor  the  operator 
is  too  heavy.  The  aim  of  this  study  is  to  estimate  the  task  load  cf  the 
operator  by  systematic  observation  of  his  behavior  and  physiological 
measurements  (ECG) .  An  observational  system  has  been  developed  which  can 
be  used  in  different  control  tasks.  In  thir  study  the  observational 
system  has  been  tested  with  three  different  control  tasks.  The  results 
were  that  the  observational  system  differentiates  between  different  levels 
of  task  load  and  the  frequency  of  the  ECG  is  higher  with  higher  levels  of 
task  load.  Further  investigations  are  being  prepared  in  which  data 
concerning  task  load  will  be  correlated  with  criteria  of  health  and  well¬ 
being  over  longer  periods  or  time. 

W/L  Cet.  Coae:  2.1,1,  4.1.,  3 

Op,.  Behav.  Code:  i.,  2.,  4 

Spare  a.  capacity  Task  comp.,  Experimental  Laboratory  Flight  simulator 

time  assess. 

Pnysioiogical  EKG 
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Sfcbe j ,  F.  and  Biro,  V.  Effect  of  psychic  load  on  the  course  of  respiration. 

Scudia  Psychology ca,  1978,  20,  67-71. 

Vn  attempt  was  made  to  analyze  the  relationship  between  respiratory  parameters 
and  psychic  load.  The  latter  was  made  to  simulate  the  following  elements:  time 
pressure,  feedback  information  on  perception  of  subject’ 3  own  performance, 
sensorimotor  coordination,  speed  and  precision  of  perception.  The  results  imply 
that  1.  the  respiratory  system  is  a  sensitive  indicator  of  psychic  load,  2. 
awareness  of  one’s  own  performance  exerts  an  activating  influence  on  soue  measures 
of  function  of  the  respiratory  system,  3.  the  selected  measures  proved 
appropriate  in  following  up  respiratorv  changer  under  conditions  of  psychic  load. 

W/L  Cat.  Code:  3.1,  4.1.11 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  ta3k  Single  measures  Experimental  Laboratory  Flight  simulator 


Physiological  Breathing  anal. 


Seihel,  K. .  Christ,  R.  E.  and  Teichner ,  W.  H.  Perception  ard  short  term  mory 
under  workload  stress.  Tort  Washington,  New  York:  U.S.  Naval  Traini  Device 
Center,  N AVT'IADEV CEN  1303-2,  June,  1964.  (AD  604  856). 

This  report  is  one  of  three  evaluations  of  differently  proposed  methods  for 
increasing  the  ability  cf  individuals  to  report  the  contents  of  briefly  exposed 
alphabetic  displays.  In  this  case,  increasing  the  number  of  consecutive 
displays,  the  number  of  displays  per  unit  time,  and  the  number  of  letters 
per  display  all  lead  to  an  increase,  or  at  least  no  decrease,  in  the  total 
number  of  letters  correctly  reported  when  the  individual  was  asked  to  report 
all  that  he  had  seen.  These  forms  and  levels  of  input  stress  did  not  lead  to 
breakdown  in  performance.  If  individuals  were  called  on  to  report  only  certain 
parts  of  what  they  had  seen,  however,  then  the  increases  in  input  stress  lead 
to  decreases  in  total  number  of  correctly  reported  letters.  The  results 
suggest  that  individuals  protect  themselves  from  high  input  rates  by  filtering 
c  it  what  they  cannot  handle,  and  only  if  they  must  process  the  information  are 
high  input  rates  likely  to  lead  to  performance  breakdown.  The  military 
implications  of  the  results  are  discussed. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4.1 

Primary  task  Single  measures  Experimental  Laboratory  Background 


262 


SY-2/R-80 


Seifert,  R. ,  Daniels,  A.  F.  and  Schmidt,  K.  A  method  of  man-display/control 
system  evaluation.  Proceedings  of  the  A  CARD  Conference  on  Guidance  and 
Control  Displays,  AGARD-CP-96,  0-1  -  8-8.  (AD  739  779). 

The  paper  describes  a  method  for  evaluating  the  design  and  assessing  the  layout 
of  an  aircraft  cockpit.  This  method  can  also  be  readily  applied  to  the  evaluation 
of  other  display/control  systems.  The  objectives  of  the  study  and  cheir  timing 
in  relation  to  the  overall  development  process  are  discussed.  Factors 
significantly  affecting  the  design,  such  as  scenario,  and  operational  and  equipment 
requirements  are  introduced  and  a  description  of  the  rig  facility  provided.  The 
use  of  the  Cooper-Harper  rating  system,  Semantic  Differentials  end  Guided 
Interviews  in  the  analysis  of  subject  performance  and  opinion  is  described. 

Finally  the  paper  concludes  that  complex  man -display /control  systems  can  only 
be  optimized  by  tne  adoption  of  a  comprehensive  approach  to  experimental  studies 
of  the  kind  described  In  the  paper. 

VVL  Cat.  Cod s i  1. 

Up.  Behav.  Code:  1. ,  2. ,  4. 

Opinion  Rating  icale  Construct  Laboratory  background 

Questionnaire  Experimental 


Sekiguchi,  C.t  Handa,  Y.,  Gotoh.  M.,  Kurihara,  Y.,  Magas aw a.  A.,  and  Kuroda,  i. 
Evaluation  method  of  mental  workload  under  flight  conditions -relationship  to 
heart  rate  variability.  Aviation,  Spcce,  and  Environmental  Medicine,  1978, 

49,  920-925.  ~  . 

To  analyze  the  relationship  between  heart  rate  variability  (HRV)  and  the  flight 
tasks  of  pilots,  HRV  of  various  mental  ana  physical  work  stressors  were  investigated. 
For  the  physical  stress  on  the  treadmill,  S.D.  of  heart  rate  sequence  showed  a 
minimum  value  at  medium  stresses  and  remained  there  until  the  maximum  stress. 

However,  the  centrifuge  acceleration  test  presupposed  special  physical  stresses, 
and  S.D.  was  almost  same  as  the  resting  findings.  In  the  tracking  tasks,  which 
presupposed  maximum  interpretative  actions,  the  increase  in  the  mean  heart  rate 
(MHR)  was  small  with  the  S.D .  increased  a  greater  amount  than  for  resting  results. 
Consequently,  preflight  checks  and  level  flight  { hases  presupposed  medium 
interpretative  actions  and  mental  stress  with  reserve  apacicy.  Takeoff  and  landing 
phases  were  considered  as  botn  high  interpretative  actiou  and  high  emotional 
stress  situations.  Acrobatic  and  gunnery  training  flight  phases  were  considerau 
physical  load,  strong  interpretative  actions,  and  emotional  etrers  tasks, 


W/L  Cat.  Code: 

4.1.3,  4,1  10 

Op.  Behav.  Code: 

1,,  2.,  4. 

Physiological 

Heart  rate. 

Experimental  Laboratory 

Flight  simulator 

n.r.  var. 

Simulate r 

Flight  test 
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Sera-Jaeobsen,  C.  W.  3CG  monitoring  of  heart  failure  and  pilot  load/overload 
by  the  Vesla  seat  pad.  Aviation.  Space,  and  Environmental  Medicine,  1976, 

47,  441-444.  '  “  ~  . . . 

Heart  failure  has  caused  sudden  incapacitation  of  pilots  in  command  of  commercial 

airliners.  These  fatal  episodes  have  occurred  in  connection  with  takeoffs  and 

landings,  and  have  resulted  in  incidents  as  well  as  major  accidents.  Sudden 
cardiac  arrest  or  serious  episodes,  such  as  ventricular  tachycardia,  usually 
cannot  be  detected  at  autopsy.  A  number  of  accidents  due  to  unknown  reasons  or  to 
"pilot  error"  can  be  due  to,  and  some  probably  are,  cardiac  breakdown.  The  Vesla 

Seat  Pad  is  a  device  for  biomedical  monitoring  of  ECG  signals  from  human  subjects 

without  attachment  to  the  subjects  of  any  leads  or  sensor  devices.  It  is  capable 
of  obtaining  appropriate  ECG  signals,  transmitted  to  the  pad  through  the  medium  of 
the  subject's  perspiration,  for  monitoring  the  subject's  heart  action.  ECG  signals, 
together  with  other  data,  can  be  electronically  processed  and  used  to  warn  the 
co-pilot  and  tower  of  impending  hazard.  The  "dead  man's  button"  with  an  overload 
warding  system  could  greatly,  when  taken  into  use,  improve  flying  srfety. 

W/L  Cat.  Code :  4.1.3,  4.1.10 

Op.  Sehav.  Coda?  1*,  2.,  3.,  4. 

Physiological  EKG  Construct  Laboratory  Flight  simulator 

Heart  rate.  Experimental  Flight  test 

h.r.  var. 


Senders,  J.  Axiomatic  models  of  workload.  In  K .  Moray  (Ed.)  Mental  workload: 
its  theory  and  measurement.  New  Vork :  Plenum  Prase,  1979,  263-267. 

Thie  paper  provides  definitional,  axiomatic  statements,  and  hypotheses  concerning 
workload.  Several  classes  of  workload  arc  presented,  including  study-state 
workload,  non-stuuy-state  workload,  internal  switching  load,  tine  cost  of 
switching,  and  motivation  and  effort. 

W/L  Cat.  Code t  2.1,  3.3 

Op.  Behav.  Code:  1.,  2. 

Spare  m.  capacity  "ask  analytic  Construct  None  Background 

Primary  task  Math,  modeling 


264 


SY-Z7R-80 


Senders,  J.W.  Thu  human  operator  as  a  monitor  and  controller  of  multidegree  of 
freedom  systems.  IEEE  Transactions  or.  Human  Factors  in  Electronics,  1964, 
HFE-5,  2-5. 

Although  moat  research  and  theory  building  on  human  operator  performance  has 
considered  the  operator  to  be  a  continuous  single-channel  controller,  straight¬ 
forward  examination  of  real  situations  and  real  behavior  showu  him  to  be  a 
sampled-data,  commutated  single-channel  controller.  This  arises  from  the 
fact  that  the  human  operator  must  distribute  his  attention  sequentially  over 
many  information  sources.  Both  monitoring  and  controlling  behavior  are  subject 
to  the  constraint  that  the  operator's  eyes  can  fixate  on  only  one  place  at  a 
time.  Thicr  report  sets  forth  a  model  which  attempts  to  predict  the  relation 
between  the  kind  and  rate  of  Information  displayed  on  any  display  and  the 
frequency  and  duration  of  samples  made  of  that  display.  The  approach  utilizes 
the  notion  that  it  is  possible  to  quantify  the  attentional  demand  placed  on  the 
controller  by  each  source  of  information  in  a  complex  man-machine  system.  The 
attentional  demand  can  be  calculated  cn  the  basis  of  the  bandwidth  and  required 
precision  of  readout  of  the  signal  presented  by  an  information  source. 

W/L  Cat.  Code:  2.1.2 

Op.  Behav.  Code:  1. ,  2. 

Spare  m.  capacity  Inform,  theory  Construct  Laboratory  night  simulator 

Experimental 


Senders,  J.W.  The  estimation  of  operator  workload  in  complex  systems.  In 

K.B.  DeGreene  (Ed.)  Systems  Psychology .  New  York:  McGraw-Hill,  1970,  207-216. 

Eye  movements  and  visual  scanning  processes,  considered  the  major  indicator  of 
operator  workload,  are  emphasized  in  this  discussion.  Human  monitors  of  systems 
sample  instruments  at  different  rates  and  for  different  durations  in  a  consistent 
way  which  appears  to  be  almost  completely  a  function  of  the  nature  of  the  signal 
presented.  Shannon  (1948)  and  Shannon  and  Weaver  (1949)  showed  that  the  infor¬ 
mation  in  bits  per  second  generate^  by  a  continuous  time  function  (subject  to 
certain  limitations  regarding  the  shape  of  the  spectrum)  was  directly  proportional 
to  the  bandwidth  of  the  signal  in  cycles  per  second,  and  to  the  logarithm  of  the 
ratio  of  the  signal  power  to  the  permissible  mean  square  error  power  in  the  read¬ 
out.  An  extended  theory  based  on  the  notion  of  a  "queue"  of  instruments  waiting 
for  attention  provides  a  means  of  generating  probability  distributions  of  demand 
and  a  consequent  estimation  of  the  reliability  of  the  operator  as  a  system 
constituent. 


W/L  Cat.  Code:  2.1.2,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 


Spare  m.  capacity  Inform,  theory  Construct  Flight  simulator  Flight  simulator 
Primary  task  Kr.th.  model 
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Senders,  J.W. ,  Kris tc-fff arson,  A.B.,  Levison,  W.H.,  Dietrich,  C.W.  ant!  Ward,  J.L. 
The  attentional  demand  of  automobile  driving.  Highway  Research  Record,  1967, 
No.  195,  15-33. 

A  theoretical  analysis  and  an  experimental  investigation  of  certain  aspects  of 
automobile  driver  information  processing  were  undertaken.  The  theoretical 
analysis  was  the  result  of  an  effort  to  avoid  difficulties  associated  with  a 
aervomechanistic  approach  to  the  automobile  driving  problem.  The  analysis  is 
predicted  on  the  assumption  that  a  driver's  attention  is,  in  general,  not 
continuously  but  only  intermittently  directed  to  the  road.  A  simple  threshold 
model  appears  to  be  a  useful  analog  of  the  driving  process.  The  analysis  makes 
specific  predictions  about  the  form  of  the  functional  relationship  between 
intervals  between  observations  and  vehicle  speed.  The  experimental  program  had 
two  goals.  One  was  the  empirical  investigation  of  the  relation  between  amount 
of  Interruption  of  vision  and  driving  speed.  The  other  was  the  determination 
of  the  parameters  in  the  mathematical  model.  This  report  presents  the  results 
of  the  theoretical  and  experimental  investigation. 

W/L  Cat.  Code:  2.1.2,  2.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Inform,  theory  Construct  Field  Flight  simulator 

Occlusion  Experimental 


Senders,  J.  W.  and  Pooner  M.  J.  M.  A  queueing  model  of  monitoring  and  supervisory 
behavior.  In  T.  B.  Sheridan  and  G.  Johannsen  (Eds.)  Monitoring  behavior 
and  supervisory  control.  New  York:  Plenum  Press,  1976,  2A5-259. 

In  the  design  of  workplaces  for  monitoring  and  supervisory  activity,  economic  and 
physical  space  requirements  play  an  importa.it  role.  These  requirements  as  well 
as  human  factors  engineering  requirements  must  be  met.  This  paper  describes 
mathematical  models  for  assessing  human  operator  behavior  in  such  systems.  The 
model,  arc  based  on  information  theoretic  concepts  combined  with  queueing  models 
of  instrument  servicing.  The  concept  of  avoiding  system  failure  by  maintaining 
manageable  task  demands  is  presented. 

W/L  Cat.  Code:  2.1.2,  3.3 

Op.  Behav.  Code:  1.,  2. 

Spare  m,  capacity  Information  theoretic  Construct  None  Flight  simulator 
Primary  task  Math,  modeling 


266 


5  Y -27*1-80 


Sheridan,  T.B.  and  Stasseu,  H.O.  In  N.  Moray  (Ed.)  Mental  workload;  ita  theory 
and  measurement .  New  York:  Plenum  Press,  1979,  219-233^. 


Alternative  definitions  of  workload  are  presents  in  a  control  paradigm,  and 
various  trade-offs  between  workload  factors  are  considered.  Descriptions  of 
workload  ir.  terms  of  stress  and  strain,  capacity,  and  attention  allocation  are 
briefly  reviewed.  The  utility  of  applying  foranl  models  of  workload  is 
described  in  terms  of  candidate  models  which  include  t!  *  optimal  control  model, 
decision  models,  information  channel  models,  and  activation/uncertainty  models. 


W/L  "at.  Code: 

Op .  Behav .  Code : 

Spare  m.  capacity 

Primary  task 


1.1.2,  3.3 

1. ,  2. ,  4. 

Inform,  theory 

Math,  model 


Construct 


None 


Flight  simulator 


Sherman,  M.  R.  The  relationship  of  eye  behavior,  cardiac  activity  and  electro¬ 
myographic  responses  to  subjective  reports  of  mental  fat  gue  and  performance 
on  a  Doppler  identification  task.  Master's  thesis,  Naval  Postgraduate  School, 
Monterey,  California,  September,  1973.  (AD  769  754). 


This  research  Investigated  relationships  between  subjective  fatigue,  performance, 
and  four  physiological  parameters:  situ.3  arrhythmia,  pupil  behavior,  blink  late, 
and  tension  of  the  neck  muscles.  Fatigue  was  induced  by  a  doppler  recognition 
task  and  rigid  body  posture.  Performance  was  measured  as  the  proportion  of 
correct  doppier  identifications .  There  was  no  detection  of.  a  performance 
change  during  che  two  and  one  half-hour  experimental  sessions.  Sinus  arrythmia 
and  eyelid  blink  rate  were  also  found  to  remain  unchanged.  An  alteration  was 
found  in  the  mea??ures  of  neck  muscle  tension  levels,  subjective  fatigue,  and 
the  average  pupil  diameter.  Subjective  ratings  of  fatigue  were  found  to  ba 
highly  correlated  with  time-on-task  end  the  electromyographic  response  of  certain 
neck  muscles.  Polynomial  regression  indicated  a  significant  linear  relationship 
between  the  subjective  ratings  and  the  tension  measured. 


W/L  Cat.  Code:  1.2,  3.1,  4.1.4,  4.1.7,  4.1.8,  4.1.S,  4.1.10 


Op.  Behav.  Code:  2.,  3.,  4. 

Opinion  Multiple  Experimental  Laboratory 

Primary  task 

Physiological 


Flight  simulator 
Flight  test 


isvarww 
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I 

I 

i 


Shiffrin,  R.  M.  and  Gardner,  G.  T.  V'aual  processing  capacity  and  attention 
control.  Journal  of  Experimental  Psychology,  1972,  93,  72-82. 

Three  experiments  tested  whether  visual  processing  operates  under  attentional  control, 
and  with  tempcral-spntial  capacity  limitations.  The  Ss  identified  which  of  two 
key  letters  was  present  in  briefly  presented  four-letttr  displays.  Modelu 
postulating  at ten clonal  control  anu  limited  capacity  would  predict  an  advantage 
for  the  sequential  condition  since  In  this  case  processing  capacity  need  not  be 
simultaneously  shared  among  four  letters.  The  results  demonstrated  simultaneous 
and  sequential  conditions  to  be  equal.  It  was  concluded  that  the  initial  stages 
of  visual  processing,  up  to  at  least  the  level  of  letter  recognition,  take  place 
without  capacity  limitation  and  without  attentional  control. 


W/L  Cat.  Code : 


3.1 


Op.  Behav.  Code:  1.,  2. 

Primary  task  Single  measures  Experimental  Laboratory  Background 


Shuluan,  H.G.  and  Briggs,  C.E.  Studies  of  performance  in  complex  aircrew  tasks. 
Columbus,  Ohio:  The  Ohio  State  Univerr.ity,  Research  Foundation,  RF  Project 
2718,  Final  Report,  December,  1971.  (AD  7.53  762). 


1 

* 

I 

Q]  ,  k.»U  ini. 


The  basic,  objective  of  the  research  described  in  this  report  was  the  investigation 
of  human  perforaw-nce  under  condit1  uia  of  divided  attention.  This  research  has 
fnmsed  on  performance  in  two  types  of‘  divided  attention  paradigms  referred  to  a e 
the  sequential  and  simultaneous  demand  paradigms.  Re. sc- arch  on  the  simultaneous 
dot  ’  situation  centered  on  performance  when  a  memory  task  was  t  L..e- shared  with 
a  pursuit  tracking  task  simi  ar  in  principle  to  a  vehicular  centre ;  task.  The jo 
experiments  snowed  a)  that  decrements  occur  in  both  tracking  ar.d  retention 
performance,  b)  that  these  increments  increase  with  ignal  complexity  on  the 
tracking  task  and  acoustic  similarity  on  the  memory  task,  end  c)  that  practice 
reduces  these  decrements  by  an  amount  pioportional  to  the  size  of  the  initial 
decrement.  Experiments  on  sequential  demand  time-sharing  focus. d  on  two  basic 
situations.  First  were  situations  characterized  by  heavy  memory  loads  and  inter- 
stimulus  intervals  between  1  and  8  seconds.  Second  were  .  *  wit  ions  involving  low 
dimcry  loadc  and  interstitial  us  Intervals  between  .1  and  l.l.  v'~onda.  1  o  both 
sit  aa t ions,  a  t  ;„me-sharing  decrement  cm  rs  and  is  propo  -ion  .  to  the  inter- 
i*»  inulus  interval. 


W/L  Cat.  Code: 

Op.  Behav .  Code: 

Spare  m.  capae.it > 
Primary  task 


2.2.1,  2.2.2  3.2 

i .  ,  2 .  ,  '* . 

Subsidiary  task  Exp  nr  :mc.;  -  i 
Sing  lk.  me  a  Fores 


Labor  y  Flight  imulatc: 
Flight  Flight  test 

Simula  or 
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Siegel,  A.  I.,  Lan terrain ,  R.  S.,  Plstzer,  H.  L.  and  W?lf,  J.  J.  Techniques 
for  evaluating  operator  loading  In  man-machine  sys >ens:  Development  of  a 
method  for  real  time  assessment  of  operator  overlo«ding.  Wayne,  Pennsylvania: 
Applied  Psychological  Services,  January,  1976.  (AJ>  479  045). 

The  logic  involved  in  deriving  certain  constants,  thought  important  for 
describing  the  human  transfer  function,  is  presented.  Then  an  experiment 
investigating  the  effects  of  varying  operator  alertness  level  (sleep 
deprivation)  on  two  of  the  constants  is  described  and  the  results  presented. 

In  the  experiment,  subjects  performed  compensatory  tracking  and  a  series  of 
cognitive  ar.d  perceptual  motor  tasks  at  intervals  over  a  27  hour  period  of 
sleep  deprivation.  The  results  were  not  in  accordance  with  the  preexperimental 
hypothesis,  which  stated  that  the  two  constants  derived  should  decrease  as  the 
alertness  level  decreased  (increasing  period  of  sleep  deprivation).  On  the 
other  hand,  some  relationship  was  found  between  one  of  the  transfer  function 
constants  and  the  scores  of  the  subjects  on  the  accessory  intellectual  and 
cognitive  tasks.  Several  possible  explanations  for  the  findings  are  presented. 

W/L  Cat.  Code:  2.2.1,  3.3 

Cp.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  teak  Math,  model  Flight  teat 


Sisgel,  A.  I.  and  Williams,  A.  R. ,  Jr.  Identification  and  measurement  of 
intellective  load  carrying  thresholds.  Waime,  Pennsylvania:  Applied 
Psychological  Services,  AFOSR-'TR- 75-0593,  December,  1974.  (AT  A001,  159). 

The  conjecture  was  investigated  that  the  intellective  load  carrying  capability 
for  selected  intellective  functions  is  identifiable  and  measurable,  ‘'intellective 
load  carrying  failure  was  defined  as  the  point  at  which  a  change  in  transfer 
^faction  components  occurs  ss  a  tracking  ,.nd  a  scaled  intellective  function  were 
corcomitantly  performed.  The  scaled  Intellective  functions  were  drawn  from 
the  Guilford  Structure-of* Intellect  model.  The  transfer  function  components 
included  amplitude  ratio  and  phase  lag  as  defined  by  the  frequency-response 
analytic  method.  Anticipated  between  individual  and  between  itellective 
function  differences  were  found.  The  ability  to  isolate  the  intellective  load 
carrying  threshold  for  individual  subjects  and  for  individual  intellective 
functions  was  demonstrated. 

W/L  Cat.  Code:  3.1,  3.3 

Op.  Behav.  Code:  1.,  2.,  4.2 

Primary  task  Single  measures  Construct  Laboratory  Flight  simulator 

Math,  model  Experimental 
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Siegel,  A. I.  and  Wolf,  J.J. 
performance  interaction. 


Man-machine  simulation  models: 
New  York:  Wiley,  1969. 


Psychosocial  and 


Techniques  for  including  characteristics  of  both  individuals  and  groups  into 
the  logic  of  digital  simulation  are  discussed.  Two  well  defined  model*  in  which 
effects  of  such  variables  as  stress,  operator  proficiency,  morale,  and  group 
psychosocial  efficiency  are  simulated  as  part  of  an  operational  task.  Methods 
for  system  optimization  early  in  the  development  stage  and  a  basis  for  estimating 
manpower  and  skill  requirements  within  a  system  are  described.  A  discussion  of 
general  simulation  methods  involved,  the  costs,  advantages  and  disadvantages,  and 
the  types  of  results  which  can  be  expected  from  digital  computer  simulation  are 
included.  Techniques  for  considering  the  handling  of  emergencies,  sick  personnel, 
work  ciiw  formations,  equipment  failure,  group  selection,  and  interopreator 
communication  in  timeline  modeling  are  also  presented. 

W/L  Cat.  Code:  2.1.1 


Op .  Behav .  Code :  1.,  2.,  3.,  A. 


Spare  m.  capacity  Taek  comp.,  Construct  Simulator  Flight  simulator 

time  assess. 

Flight  test 


Siegel,  A.  I.,  Wolf,  J.  J. ,  Fischl,  M.  A.,  Miehle,  W.  and  Chubb,  G.  V. 

Modification  of  the  Siegel-Wolf  operator  simulation  model  for  on-lire 
experimentation.  Wright-Patterson  AFB ,  Ohio:  USAF  Aerospace  Medical 
Research  Laboratory,  AMRL-TR- 71-6C ,  June,  1971. 

The  primary  effort  in  this  study  was  to  modify  the  existing  Siegel-Wolf  operator 
simulation  model  to  allow  dynamic  interaction  with  an  experimental  subject 
performing  on-line  in  some  sore  of  pseudo  real  time  environment.  The  Siegel- 
Wolf  model  is  capable  of  simulating  task  performance  by  a  one  or  two-mar  crew 
to  determine  the  impact  human  factors  have  on  sjstems  effectiveness  and  mission 
success.  The  BUIC  III  active  tracking  task  was  used  in  this  work  as  a 
representative  environment.  The  other  three  phases  of  the  effort  dealt  with 
the  conceptual  aspects  of  the  model.  Variables  known  to  contribute  to  performance, 
but  which  were  not  incorporated  into  the  model,  were  considered  to  determine 
their  possible  contribution  to  enhancing  the  model's  predictive  validity.  Four 
of  these  variables  were  identified  as  the  more  promising  candidates:  graded 
task  assent  allty,  Information  load,  goal  proximity  or  goal  gradient  effects, 
and  decision  making.  Flow  charts  were  prepared  tc  illustrate  how  these  variables 
could  be.  Incorporated  into  the  model,  but  no  computer  programming  was  attempted. 

The  third  phase  of  the  effort  involved  the  definition  of  an  alternate  method  for 
predicting  operator /system  performance.  The  last  phase  of  the  effort  entailed 
the  examination  of  additional  areas  where  the  model  could  be  expanded. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Task  comp. ,  Construct  Laboratory  Flight  simulator 

time  assess.  Experimental 


■gagrr.-.-a."! 


g.  r hi  i  if TM 
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Siegel,  A.I.,  Volf,  J.J  and  Sorenson,  R.T.  Techniques  for  evaluating  operator 
loading  in  men-macliine  systems :  Evaluation  of  a  one  or  a  two-opeiator  system 
evaluation  model  through  a  controlled  laboratory  test.  Wayne,  Pennsylvania: 
Applied  Psychological  Services,  Contract  Nonr  2-492(00),  July,  1962. 

(AD  284  182). 

A  stochastic,  digital  computer  simulation  modal  was  previously  derived  for  and 
applied  to  the  problem  of  simulating  one  or  two-operator  man-machine  systems. 
Further  test  of  the  validity  of  the  model  through  comparisons  of  the  model's 
predictions  of  team  performance  with  the  actual  performance  of  trained  teams 
on  a  man-machine  task  is  described.  A  complex  rwo-operator  man-machine  equipment 
task  involving  team  and  individual  branching,  operator  stress  buildup,  looping, 
cooperative  work,  communication,  waiting,  etc.,  was  developed.  This  seme  task 
was  inserted  into  the  high  speed  computer  programmed  in  accordance  with  the  model. 
On  the  basis  of  non-statistically  significant  differences,  in  nine  of  ten  possible 
comparisons,  it  was  concluded  that  support  is  gained  for  a  contention  favoring 
the  validity  of  the  model. 


W/L  Cat.  Code: 

2.1.1,  3.1 

Op.  Behav.  Code: 

1  7  ?  4 

-L.,  ..  ,  -»• 

Spare  m.  capacity 

Task  comp..  Experimental  Laboratory  Flight  simulator 

time  assess. 

Primary  task 

Single  treasures 

Simmons,  R.  R.  Methodological  considerations  of  vieual  workloads  of  helicopter 
pilots.  Human  Factors,  1979,  21,  353-367. 

Modifications  to  and  applications  of  the  Eye  Mark  Recorder  corneal  reflection 
apparatus  for  the  assessment  of  the  visual  performance  and  workload  of  pilots 
during  helicopter  operations  are  presented.  Modifications  accomplished  to  ensure 
compatibility  with  the  helicopter  flight  environment  include  adjustments  to  the 
face  mask  for  comfort  and  stability,  a  variable  power  supply,  a  special  mount  for 
the  recording  camera  Inside  the  helicopter  and  the  addition  of  a  blue  template  tc 
the  instrument  panel  to  allow  ior  proper  image  contrast  inside  and  outside  the 
aircraft.  Test  and  data  reduction  procedures  for  use  with  the  apparatus  are 
outlined. 

W/L  Cat.  Code:  4.1.7 

Op,  Behav.  Code:  3,,  2.,  4.1 

Physiological  Eye  movement  Experimental.  Flight  simulator  Flight  simulctor 


Z-M 


Flight  test 


Flight  test 


I 

1 

I 

I 

I 

T 

J 

1 
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r^rmons,  R.R.  and  KimbaLl,  K.A.  Methodological  considerations  of  visual  workloads 
of  helicopter  pilots.  Proceed ingc  of  t he  AGARD  Conference  cn  Methods  to 
Assess  Workload  ACARP-CPP-216,  April,  1977,  A2-1. 

A  methodology  is  described  for  assessing  inflight  oculomotor  and  perceptual  motor 
performance,  a  methodology  which  is  instrumental  in  collecting  baseline  data  of 
pilot  workload  during  various  helicopter  operations  to  include  instrument  flight, 
visual  flight,  or  terrain  flight.  Visual  performance  was  assessed  via  a  modified 
NAC  Eye  Mark  Pecorder  in  conjunction  with  a  16  mm  motion  picture  camera  with 
time  code  capability.  A  reticle  is  superimposed  on  a  primary  image  of  the  pilot's 
field  of  view  and  recorded  on  16  mm  film.  Modifications  were  accomplished  to 
allow  inflight  stability  to  the  system  for  accuracy  and  to  allow  freedom  of  head 
movement  for  the  pilot.  Inflight  performance  measures  were  also  obtained.  The 
system  measures  pilot's  cyclic,  collective  and  pedal  inputs,  and  simultaneously 
records  the  aircraft's  response  to  include  position,  acceleration,  and  rate 
changes . 

W/L  Cat.  Code;  3.2,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 


Primary  task 
Physiological 


Mt.lt.  measures 
Eye  movement 


Experimental  Flight  test  Flight  simulator 

Flight  test 


Simmons,  R.  R.  and  Kimball,  K.  A.  Operator  visual  workload  shifts  as  a  function 
of  vehicle  stability.  Proceedings  of  the  23rd  Annual  Meeting  of  the  Human 
Factors  Society,  Boston,  Massachusetts,  October  29-November  1,  1979,  352-356. 

This  research  was  Initiated  to  compare  the  visual  performance /workload  of  pilots 
during  fixed  wing  and  rotary  wing  flights.  The  ccrneal  reflection  technique  was 
used  to  obtain  the  visual  data.  The  results  demonstrate  that  visual  performance/ 
workload  of  the  pilots  was  different  for  each  aircraft.  Because  the  major 
difference  between  the  aircraft  was  the  aerodynamic  stability,  it  was  assumed 
that  the  visual  workload  was  in  fact  a  function  of  aircraft  stability.  The 
overall  purpose  of  such  research  has  been  to  provide  information  concerning 
pilots'  visual  requirements  for  safe  mission  accomplishment . 

2.1.1,  4.1.7 

1.,  2. 

Task  comp. ,  Experimental  Flight  test  Flight  simulator 

time  assess. 

Eye  movement  Flight  test 


W/L  Cat.  Code: 

Op .  Behav .  Code : 
Spare  m.  capacity 
Physiological 
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Simmons,  R.  R.t  Kimball,  K.  A.  and  Dias,  J.  J.  Measurement  of  aviator  visual 
performance  and  workload  during  helicopter  operations.  Ft.  Rucker,  Alabama: 
U.S.  Army  Aeromedical  Research  Laboratory,  77-4,  December,  1976. 

This  report  was  initiated  to  review  the  techniques  and  modifications  developed 
by  the  U.S.  Army  Aeromedical  Research  Laboratory  for  assessing  visual  performance/ 
workload  of  pilots  during  helicopter  operations.  Although  the  comeal  reflection 
technique  for  gathering  eye  movement  data  is  not  new,  innovative  modifications 
had  to  be  developed  to  permit  accurate  data  collection  in  this  flight  environment. 
This  study  reports  on  these  techniques,  modifications,  and  applications. 


W/L  Cat.  Code: 

4.1.7 

Op.  Behav.  Code: 

1.  ,  2. ,  4. 

Physiological 

Eye  movement 

Review  Flight  simulator 

Flight  simulator 

Flight  test 

Flight  test 

Simmons,  R.  R. ,  Lees,  M.  A.,  and  Kimball,  K.  A.  Visual  performance/workload 
of  helicopter  pilots  during  Instrument  flight.  Ft.  R  icker,  Alabama:  U.S. 
Army  Aeromedical  Research  Laboratory,  78-6,  January,  >.978. 


Flight  under  instrument  flight  rules  (IFR)  is  reported  to  be  one  of  the  most  im¬ 
portant  factors  contributing  to  aviator  fatigue  during  helicopter  operations. 

This  study  was  Initiated  to  collect  visual  and  psychomotor  performance  data  in  an 
attempt  to  investigate  and  study  the  general  visual  performance  of  aviators  during 
IFR  conditions.  Two  groups  of  aviators,  with  varied  experience  levels,  were  the 
subjects.  A  NAC  Eye  Mark  Recorder  and  the  Helicopter  In-Flight  Monitoring  System 
were  utilized  to  collect  the  required  data.  The  results  indicated,  among  other 
findings,  that  pilot  subjective  opinion  does  not  agree  with  objective  data. 
Additionally,  the  attitude  indicator  and  radio  compass  comprised  over  60%  of  the 
pilots'  total  visual  workload,  while  the  aircraft's  status  gauges  were  monxtored 
less  than  10%  of  the  total  time.  These  date  should  provide  invaluable  information 
concerning  the  visual  requirements  of  pilots  for  safe  helicopter  operations. 


W/L  Cat.  Code:  1.1,  3.1,  4.1.7 

Op .  Behav ,  Code :  1 . ,  2 . ,  4 . 


Opinion 
Primary  task 
Physiological 


Fating  scale  Experimental  Flight  test  Flight  simulator 
Single  measures  Flight  test 

Eye  movement 
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Simmons,  R.  R. ,  Lees,  M.  A.,  and  Kimball,  K.  A.  Aviator  visual  perforarmce: 
a  comparative  study  of  a  helicopter  simulator  and  the  UH-1  helicopter.  In 
AGARD  Operational  Helicopter  Aviation  Medicine,  AGARD-CP-255,  May,  1978, 

52-1  -  52-13. 

This  research  project  was  initiated  to  compare  the  visual  performance/workload 
of  pilots  during  helicopter  and  simulated  helicopter  instrument  flights  (IFR). 

The  corneal  reflection  technique  was  utilized  to  obtain  the  visual  data.  Although 
pilot  performance  in  the  Army's  UH-1FS  simulator  and  the  UH-1H  helicopter  were 
similar,  several  differences  were  noted.  Additionally,  the  zone/cost  factor 
theory  from  previous  ctudies  was  expanded.  The  overall  purpose  of  such  research 
has  been  to  provide  information  concerning  pilots'  visual  requirements  for  safe 
mission  accomplishment. 


W/L  Cat.  Code: 

4.1.7 

Op.  Behav.  Code: 

1.,  2.,  4. 

Fhysio logical 

Eye  movement 

Experimental  Flight  simulator 

Flight  simulator 

Flight  test 

Flight  test 

Simmons,  R. ,  Sanders,  M. ,  and  Kimball,  K.  Visual  performance:  a  method  to  assess 
worklcad  in  the  flight  environment.  In  B.  0.  Hartman  and  R.  E.  McKenzie  (Eds.) 
Survey  of  methods  to  assess  workload.  AGARD-AC—  246 ,  August,  1979,  73-81 

This  paper  addresses  the  assessment  of  worklcad  of  the  visual  information  input 
channel.  A  cost  factor  (CF)  theory  is  presented  which  provides  a  more  concise 
picture  of  visual  workload  than  the  classical  methods.  The  applications  section 
suggest  that  the  CF  theory  is  a  valuable  tool  in  testing  and  determining  what  the 
visual  workload  should  be  for  combat  proficient  pilots,  how  long  pilots  with 
varying  degrees  of  proficiercy  could  be  expected  to  fly  in  combat,  and  aircraft 
design  requirements  to  reduce  onset  of  fatigue-induced  errors.  CF  theory  can 
also  be  used  to  test  and  determine  varying  mission-related  workload. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Primary  task 
Physiological 


3.1,  4.1.7 

1.,  2. 

Single  measures  Construct  Flight  simulator  Flight  simulator 

Eye  movement  Experimental  Flight  test  Flight  test 
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Simonov,  P.  V.  and  Frolov,  M.  V.  Analysis  of  the  human  voice  as  a  method  of 
controlling  emotional  state:  Achievements  and  goals.  Aviation,  Space,  and 
Environmental  Medicine.  1977,  48_,  23-25. 

Background  factors  and  those  of  formant  structure,  spectral  and  spectro-temporal 
characteristics  of  rapid  and  slow  speech  components,  temporal  peculiarities,  and 
intensity  of  speech  turned  out  to  be  informative  indices  of  the  human  emotional 
state.  Application  of  mathematical  methods ,  in  particular  methods  of  recognition 
theory,  to  these  factors  helped  to  assess  the  degree  and  the  psychological  sign 
of  emotion,  to  diagnose  the  status  of  attention  and  fatigue,  and  to  differentiate 
emotional  and  physical  stress.  The  paper  outlines  the  results  obtained  in  model 
experiments  on  cosmonaut  A.  Leonov  at  different  flight  stages,  Including  EVA, 
jn  Vo8khod-2. 

W/L  Cat.  Code:  4.3 

Op.  Behav.  Code:  1. ,  2.,  3.,  4. 


Physiological  Speech  pett. 

anal . 


Experimental  Flight  test  Flight  simulator 

Flight  test 


Simonov,  P.  V.,  Frolov,  M.  V.,  and  Sviridov,  E.  P.  Characteristics  of  the 
electrocardiogram  under  physical  and  emotional  stress  in  man.  Aviation, 

Space,  and  Environmental  Medicine,  1975,  46,  141-143. 

The  changes  in  the  length  of  R-R  interval  and  heart  rate  are  widely  used  for:.' 
estimation  of  man's  physical  state.  However,  this  ECG  index  has  several  drawbacks 
Including  a  relatively  low  sensitivity  and  non-specificity,  indirection  of 
changes  under  different  states:  attention  and  fatigue,  physical  and  'motional 
stress,  etc.  Moreover,  one  and  the  same  factor,  e.g.  emotional  stress,  can  lead 
both  to  a  decrease  and  an  increase  in  the  heart  rate.  Hence,  it  Is  necessary  to 
find  other  more  adequate  ECG  parameters,  which  would  enhance  the  reliability  and 
accuracy  of  assessment  of  man's  state.  The  analysis  of  data  found  in  the  literature 
and  the  results  of  our  preliminary  experiments  have  shown  that  the  amplitude  of 
the  T-peak  and  duration  of  the  R-T  interval  of  ECG  can  be  used  as  such  parameters. 


W/L  Cat.  Code: 

4.1.3 

Op.  Behav.  Code: 
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Physiological 
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Experimental 
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Simpson,  C.A.  and  Hart,  S.G.  Required  attention  for  synthesized  speech 

perception  for  two  levels  of  linguistic  redundancy.  Paper  presented  at  the 
93rd  meeting  of  the  Acoustical  Society  of  America,  State  College, 

Pennsylvania,  June  7-10,  1977. 

It  was  hypothesized  that  additional  contextual  linguistic  redundancy  in  the 
wording  of  synthesized  speech  cockpit  warnings  would  result  x„.  less  required 
attention.  Twelve  pilots  were  repettedly  presented  uni  uni.liar  warnings  in  two 
wording  foruats,  key  word  and  sentences.  Then  they  heard  the  same  warnings 
embedded  in  weather  broadcast  at  a  warning-to-  wee  :in’r  sound  pressure  le  il  ratio 
of  +3  dB.  For  both  listening  conditions  the  ta3k  was  to  read  back  the  message 
and  estimate  the  passage  of  time  during  message  comprehension  or  recognition. 

As  expected  in  the  present  study,  intelligibility  was  higher  and  response  time 
shorter  for  the  sentence  format  than  for  the  key  word  format.  For  unfamiliar 
messages,  the  tendency  to  underestimate  the  passage  of  time  was  greater  for  the 
two  word  format  than  for  the  sentence  format.  For  familiar  messages  there  was  no 
significant  difference  in  performance  on  the  time  estimation  ta°k  for  the  two 
levels  of  linguistic  redundancy. 

W/L  Cat.  Code:  2.2.3 

Op.  Behav.  Code:  2.,  3. 

Spare  m.  capacity  Time  estimation  Experimental  Laboratory  Flight  simulator 


Simpson,  C.  G.  Improved  displays  and  stabilisation  ir.  general  aviation  aircraft. 
Moffett  Field,  California:  Matronal  Aeronautical  and  Space  Administration, 
N69-24238,  November ,  1968.  (AGARD  Symposium  paper). 

A  project  is  described  which  examined  the  use  of  improved  displays  and 
automatic  flight  control  as  methods  cf  easing  the  cockpit  workload  ot  a 
single  pilot  flying  on  instruments.  The  data  indicate  an  appreciable  pilot 
workload  reduction  when  a  pictorial  navigation  display  is  employed  in 
conjunction  with  normal  instruments  for  flight  under  instrument  conditions, 
and  an  almost  equal  additional  amount  of  workload  reduction  if  the  aircraft 
is  stabilized  and  controlled  by  means  of  an  autopilot.  Such  an  improved 
cockpit  environment  also  appears  to  facilitate  instrument  training. 

W/L  Cat.  Code:  2.1,  4.2 

Op.  Behav.  Code:  1,,  2.,  4. 

Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 

Flight  test 
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Sinalko,  H.W,  Third  international  congress  on  argonouice  >  London,  England: 
Office  of  Naval  Research,  CNRL-C-19-67,  November,  1967. 

This  report  s;mmarizes  twelve  invited  papers  and  consents  on  some  additional 
contributed  papers.  The  appendix  contains  list  of  the  latter.  Principal 
sessions  included:  measurement  of  workload  in  xenta.l  tasks,  product  design, 
checklists,  relevance  of  laboratory  studies,  office  design,  and  future  needs  in 
ergonomics.  In  regard  to  mental  workload,  techniques  of  secondary  task, 
pupillary  diameter,  and  adaptive  tracking  are  reviewed  and  critiqued. 

W/L  Cat.  Code:  2.2.,  4.1.8 

Op.  Behav.  Code:  1.,  2.,  4, 

Spare  m.  capacity  Subsidiary  task  Review  None  Flight  simulator 

Physiological  Pupillary  dia. 


Smit,  J.  Pilot  workload  analysis  based  upon  in-flight  physiological  measurements 
and  task  analysis  methods.  In  T.  B.  Sheridan  and  G.  Johannsen  (Eds.) 

Monitoring  behavior  and  supervisory  control.  New  York:  Plenum,  1976,  119-124. 

During  the  last  several  decades  much  effort  has  been  directed  at  reducing  pilot 
workload.  According  to  Jahns,  the  ulti/uate  objective  of  workload  resev'rch  is  to 
develop  reliable  predictions  wf  human  effort  to  meet  predetermined  input  loads. 

This  paper  describes  the  initiation  of  a  program  designed  to  determine  which  of 
the  many  workload  estimation  techniques  are  most  applicable  to  specific  pilot 
workload  problems.  The  program  will  include  subjective,  physiological,  mid 
performance  measurement  and  will  attempt  to  correlate  them  with  relevant  personality 
traits. 

W/L  Cat.  Code:  1.,  3.1,  4.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Multiple  Construct  None  Background 

Primary  task 

Physiological 
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Smit,  J.  and  Weverinke ,  P.  H.  An  analysis  of  helicopter  pilot  control  behavior 
and  workload  daring  instrument  flying  tasks.  In  ACARJ  Operational  Helicopter 
Aviation  Medicine.  AGARD-CP-255 ,  say,  1978..  30-1  -  30-11. 

During  helicopter  instrument  hover  and  navigation  (tracking)  tasks  a  number  of 
flight  data,  physiological  measures  and  subjective  ratings  were  collected. 
Mathematical  model  were  used  to  describe  and  analyze  the  pilot’s  control  behavior 
and  attention  workload.  The  optimal  control  mo '  1  seems  to  offer  a  suitable 
framework  for  the  description  of  control  tasks  complex  as  helicopter  instru¬ 
ment  flying.  A  control  effort  model,  which  v.' ~  formulated  in  terms  of  the  optimal 
control  model,  describes  the  relationship  between  performance  and  attention  paid 
to  the  task.  The  physiological  variables  and  subjective  ratings  in  general 
reflected  the  variations  in  control  effort  connected  with  the  various  tasks. 


W/L  Cat.  Code: 

1.1,  3.3,  4.1 

Op.  Behav.  Code: 

1. ,  2. ,  4. 

Opinion 

Multiple 

Construct 

Flight  test  Flight  simulator 

Primary  task 

Experimental 

Flight  test 

Physiological 

Smith,  H.  P.  R.  A  simulator  study  of  the  interaction  of  pilot  workload  with 
errors,  vigilance,  and  decisions.  Moffett  Field,  California:  National 
Aeronautics  and  Space  Administration  (.tines  Research  Center),  NASA- I’M- 78482 , 
January,  1979. 

A  full  mission  simulation  of  a  civil  air  transport,  scenario  that  had  two  levels 
of  workload  was  used  to  observe  the  actions  of  the  crews  and  the  basic  aircraft 
parameters  and  to  recorti  heart  races-  The  results  showed  that  the  number  of  errors 
was  very  variable  among  crews  but  the  mear.  increased  in  the  higher  workload  case. 
The  increase  in  errors  wis  not  related  to  rise  ir  heart  rate  but  was  associated 
with  vigilai.ee  times  as  well  as  the  days  since  the  last  flight.  The  recorded 
data  also  made  it  possible  to  investigate  decision  time  and  decision  order.  These 
also  varied  among  crews  and  seemed  related  to  the  ability  oi  captains  to  manage 
the  tesources  available  to  them  on  the  flight  deck. 


W/L  Cat.  Code: 
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Smith,  W.  S.,  Jr.  Effects  of  neuromuscular  tension  In  the  use  of  an  isometric 
hand  controller.  Monterey,  California:  U.S.  Naval  Postgraduate  School, 
Master'f  thesis,  December,  1972.  (AD  757  252). 

The  effects  of  operator  workload  on  average  grip  pressure  and  of  neuromuscular 
tension  on  tracking  performance  were  the  objects  of  this  research.  In  one 
experiment,  a  "sub-critical"  tracking  task  was  performed  by  the  operator  while 
measurements  of  grip  pressure  were  taken..  In  a  second  experiment,  the  operator 
was  required  to  maintain  average  grip  pressure  at  specified  levels  during  100- 
second  tracking  tasks  while  his  RMS  tracking  error  was  measured.  The  results 
clearly  indicate  that  average  grip  pressure  increases  as  the  workload  Inc  ;asee 
and  that  higher  average  grip  pressures  result  in  higher  RMS  tracking  error  values. 

W/L  Cat.  Code:  3.1,  4.1.9 

Op.  3ehav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 
Physiological  Muscle  tension  Flight  test 


Soede,  M.  Reduced  mental  capacity  and  behavior  of  a  rider  of  a  bicycle  simulator 
under  alcohol  stress  or  under  dual  task  load.  Proceedings  of  the  13th  Annua , 
NASA-Unlversity  Conference  on  Manual  Control.  Massachusetts  Institute  of 
Technology,  June  15-17,  1977,  143-151. 

Experiments  were  carried  cut  in  a  bicycle  simulator  with  either  alccnol  adminis¬ 
tration  or  a  binary  choice  task  in  separate  sessions,  intending  to  reduce  the 
subject's  mental  capacity.  Before  and  after  such  sessions  a  visual  evoked 
response  measurement  was  done.  The  subject's  performance  was  analyzed  with 
describing  function  techniques.  The  results  indicate  that  alcohol  affects  the 
course  following  task  as  well  as  the  balancing  task:  i.e.  a  general  effect. 

The  binary  choice  task  is  more  specifically  influencing  the  course  following 
ta3k.  The  dual  task  shows  a  more  pronounced  effect  on  the  recovery  of  the  evoked 
response.  The  alcohol  delays  the  recovery  curve  of  the  evoked  response.  A 
tentative  explanation  can  be  given  which  agrees  with  the  performance  dJita. 


W/L  Cat,  Code:  2.2.1,  3.1,  4.1.3,  4.1.6,  4.1.10 

Op .  Behav .  Code :  1 . ,  2 . ,  4 . 


Spare  m,  capacity  Subsidiary  task  Experimental  Simulator 
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Physiological  ECP 

Heart  rate, 
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Flight  simulator 
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Soede ,  M.  On  mental  load  and  reduced  mental  capacity;  some  considerations 
concerning  laboratory  and  fl^’S  investigations.  In  N.  Moray  (Ed.)  Mental 
workload:  its  theory  and  measurement.  Mew  York:  Plenum  Press,  1979^  445-467. 

This  paper  presents  some  reflections  about  the  problem  of  mental  load  and  the 
measurement  of  the  level  of  mental  load.  A  general  model  of  the  relation 
between  mental  control  effort  and  performance  is  given.  Some  connotations 
are  made  regarding  the  notion  of  mental  capacity.  The  model  proposed  is 
suggested  to  be  applicable  in  the  particular  man-machine  situation  of  an  arm 
amputeed  patient  using  a  prosthesis.  Pilot  experiments  with  the  aim  to 
develop  methods  to  measure  the  control  effort  in  using  a  prosthesis  is  given 
as  an  example  of  the  application  of  mental  load  measures.  At  the  end  of  this 
paper  some  questions  are  raised  as  to  the  factors  which  may  restrain  progress 
in  mental  load  research. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiple  Review  Laboratory  Flight  simulator 

Spare  m.  capacity  Construct  Field 

Primary  task 
Physiological 


Soliday,  S.  M.  Effects  of  task  loading  on  pilot  performance  during  simulated 

lov-a1titude  high-speed  flight.  Fort  Eustis,  Virginia:  U.S.  Army  Transportation 
Research  Center,  USATRECOM  64-69,  February,  1965.  (AD  614  243). 

The  effects  of  task  loading  on  pilot  performance  during  simulated  low-altitude, 
high-speed  flight  were  studied.  Approximately  210  hours  of  flight  were  made 
by  experienced  pilots  in  a  moving-base  simulator  that  had  a  total  vertical 
travel  of  12  feet  and  an  acceleration  capability  of  ±  6G.  The  flights  were 
made  over  several  types  of  terrain  at  several  airspeeds  under  different 
conditions  of  navigation  task  and  emergency  task  loading.  Medium-heavy 
turbulence  was  simulated  for  all  flights.  Data  were  analyzed  in  terms  of 
human  performance  aspects  of  the  missions. 

W/L  Cat.  Code:  1.2,  3.2 

Op.  Behav.  Code:  1. ,  2. ,  4. 

Opinion  Interview  Experimental  Flight  simulator  Flight  simulator 

Primary  task  Mult,  measures  Flight  test 
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Soliday,  S.  M.  and  Schohan,  B.  Task  loading  of  pilots  in  simulated  low- 
altitude  high-speed  flight.  Human  Factors,  1965,  45-53. 

Pilots  were  task-loaded  to  various  degrees  in  simulated  low-altitude,  high¬ 
speed  flight.  Approximately  210  hours  of  flight  were  made  in  a  moving-base 
simulator  chat  had  a  total  vertical  travel  of  12  feet  and  an  acceleration 
capability  of  ±6G.  A  jet  aircraft  in  the  light  fighter  >^r  attack  category 
was  mechanized  on  the  simulator's  analog  computer.  Flights  were  made  over 
several  types  of  terrain  at  several  airspeeds  under  different  conditions  of 
navigation  task  and  emergency  task  loading.  Med ium-heavy  turbulence  was 
simulated  for  the  flights,  each  of  which  lasted  one  hour.  Performance 
deteriorated  markedly  as  terrain  slopes  increased  in  steepness  and  as  airspeed 
increased  from  .4  Mach  and  .7  Mach  to  .9  Mach.  Navigation  and  emergency  task 
performance  did  not  vary  with  any  of  the  experimental  conditions,  and  did  not 
affect  the  pilots'  ability  to  maintain  a  500  foot  terrain  clearance.  There 
was  no  evidence  of  fatigue  during  the  flights. 

W/L  Cat.  Code:  1.2,  3.2 

Op .  Behav .  Code :  l . ,  2 . ,  4 . 

Opinion  Interview  Experimental  Flight  simulator  Flight  simulator 

Primary  task  Mult,  measures  Flight  test 


Soultages,  D.  Questionnaire  theory:  modelling  of  the  pilot's  mental  load. 

Paris,  France:  Office  National  d'Etudis  et  de  Recherches  Aerospatiales, 
0NERA-NT-230 ,  1974.  (In  French.) 

The  task  carried  out  by  a  human  operator  is  modelled,  in  the  form  of  a  robot 
(in  the  sense  of  heuristic  programming),  and  the  concept  of  operator's  workload 
is  associated  to  that  of  information  processed  by  the  robot  who  makes  decisions. 
The  purpose  of  questionnaire  theory  is  to  formalize  the  concept  of  information 
processed.  The  main  definition  of  this  theory  is  presented,  preceded  by  a  brief 
survey  of  information  and  graph  theory  concepts  necessary  to  understand  them. 

The  connection  between  heuristic  programming  and  the  manner  in  which  questionnaire 
theory  permits  the  formalization  of  the  informative  cost  of  decisions  is  also 
established. 


W/L  Cat.  Code: 
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So uter,'? am,  J.  Instruments  and  methodology  for  the  assessment  of  physiological 
cofflv  of  performance  in  stressful  continuous  operations  -  the  air  traffic 
sar ‘rices  tower  environment .  Proceedings  of  the  AGARD  Conference  on  Methods 
to  Assess  Workload,  AGARD- CPP-216,  April,  1977,  A7-1  -  A7-32. 


The  study  was  designed  t  >  test  methods  and  instruments  of  potential  use  in  the 
determination  of  the  physiological  cost  of  work  performance  in  stressful 
environments.  A  second  goal  of  the  study  was  a  preliminary  test  of  the 
hypothesis  that  air  traffic  services  traditionally  considered  stressful,  was 
significantly  different  from  general  forms  of  employment  traditionally  considered 
less  stressful.  To  test  this  hypothesis  people  employed  as  air  traffic  control 
tower  personnel  were  slated  as  the  experimental  group  and  subjects  employed  in 
an  operationally  oriented  research  facility  served  as  the  control  group.  Within 
the  parameters  of  this  research  design,  consistent  statistical  significance  was 
established  when  the  entire  sample  was  recategoriead  on  the  basis  of  subjective 
sleep  adequacy  assessment  rather  than  by  job  describption. 
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Spady,  A.  A.,  Jr.  Airline  pilot  scanning  behavior  during  approaches  and 
landing  in  a  Boeing  737  simulator.  Puper  presented  at  the  AGAT.P  25th 
Guidance  and  Control  Panel  Meeting/Symposium  on  Guidance  and  Control  Design 
Configurations  for  Low  Altitude  and  TermAnul  Area  Flight,  Dayton,  Ohio, 
October  17-20,  1977. 


A  aeries  of  approaches  using  airline  pilots  in  an  FAA  qualified  simulator  has  been 
conducted.  The  teat  matrices  include  both  manual  and  coupled  approaches  for  VFE, 
Category  1  and  Category  II  conditions  A  non Intrusive  uculometer  system  was  used 
to  track  the  pilot's  eye-poiut-of- regard  throughout  the  approach.  The  results 
Indicate  that,  in  general,  the  pilots  use  a  different  scan  technique  for  the  manual 
and  coupled  (autC'  pilot  with  manual  throttle)  conditions.  For  the  manual  approach 
73  percent  of  the  time  wan  spent  on  the  flight  director  and  13  percent  on  airspeed 
aa  opposed  to  50  percent  on  flight  direction  and  23  percent  on  airspeed  for  the 
coupled  approaches.  For  the  vis’ial  portion  of  approach  frou  leas  than  100m  (300 
ft)  to  toucbdjwit  or  when  the  touchdown  point  came  into  view,  the  pilots  tend  to 
fixate  on  their  aius  or  touchdown  area  until  the  flare  initiation,  at  v’hich  time 
they  let  their  eye-point-of-regard  move  up  the  runway  to  use  the  centerline  lights. 
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Spady,  a.  A.,  Jr.  Airline  pilot  scan  patterns  during  simulated  ILS  approaches. 
Hampton,  Virginia:  National  Aeronautics  and  S?*  Administration,  Langley 
Research  Canter,  NASA- TP-1250,  October,  1978. 

A  series  of  instrument  system  approaches  have  been  conducted  using  seven  airline 
pilots  in  a  Fedetal  Aviation  Administration  qualified  simulator.  The  test  matrix 
Included  both  manual  and  coupled  approaches  with  and  without  atmospheric  turbulence 
in  Category  II  visibility  conditions.  The  results  indicate  that,  in  general, 
the  pilots  use  different  scan  techniques  for  the  manual  and  coupled  conditions. 

A  comparison  between  objective  measures  of  the  instrument  scan  (oculometer  data) 
end  subjectivt  pilot  opinion,  ranking  their  use  of  each  instrument,  has  been 
included.  The  pilots  consistently  ranked  the  instruments  in  terms  of  most  used 
to  least  ueed.  The  ranking  obtained  from  the  oculometer  data  agrees  with  the 
pilot  ranking  for  the  flight  director  and  airspeed,  the  most  important  instruments. 
However,  the  pilots  apparently  ranked  the  other  instruments  in  terms  of  their 
concern  for  information  rather  than  according  to  their  actual  scanning  behavior. 
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Sperandio,  J.  C.  Variation  of  operator's  strategies  and  regulating  effects  on 
workload.  Ergonomics ,  1971,  14,  571-577. 

In  a  real  work  situation  the  operative  strategy  choosen  by  subjects  depends  on 
three  variables,  the  characteristics  of  the  operator  (training,  motivation,  age, 
health,  etc.);  the  characteristics  of  the  task,  i.e.,  the  level  of  task  require¬ 
ments;  and  the  level  of  v/orkload,  which  itself  results  from  the  o.  erator  strategy. 
Ergonomist j  try  often  to  measure  the  workload,  but  do  not  pay  enough  attention 
to  the  regulating  effects  exerted  by  the  workload,  through  t>.cd-back ,  on  the 
strategy  used  by  operators.  This  paper  summarizes  an  experimental  scudy  carried 
out  in  a  ATCC ,  showing  how  air  traffic  controllers  modify  their  operative 
methods  when  workload  Increases. 
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Speraodio,  J.  The  regulation  of  working  methods  as  a  function  of  work- load 
among  air  traffic  controllers.  Ergonomics ,  1978,  21,  195-202. 

A  series  of  field  studies  among  air  traffic  controllers  is  reviewed.  It  largely 
concentrated  on  regulatory  aspects  of  operational  behavior,  using  a  model  based 
on  the  coucept  of  'economy'  in  the  individual's  selection  of  operating  procedures. 
Attention  is  directed  at  processes  involving  reasoning,  the  receipt  and 
transmission  of  information,  and  the  division  of  tasks  between  controllers  at 
the  same  station.  The  basic  hypothesis,  which  is  supported  by  numerous  data, 
is  that  for  a  given  tack  and  a  giver,  controller  certain  operating  procedures 
are  less  costly  than  others;  that  is,  they  generate  lower  levels  of  load, 

These  procedures  will  therefore  be  more  and  more  employed  as  work  demand 
increases,  together  with  the  relaxation  of  certain,  self-imposed,  qualitative 
criteria.  This  regulatory  feedback  between  workload  and  operating  methods 
is  used  by  the  controller  to  avoid  the  abrupt  onset  of  overload  conditions 
and  tc  delay  satiation.  For  the  Investigator,  these  progressive  charges  in 
operating  procedure  can  provide  indirect  Indices  of  load.  Several  ergonomic 
consequences  of  this  approach  for  system  design  are  discussed. 
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Spicrzza,  R.  J. ,  Piukua,  A.  R.  and  O'Donnell,  R.  D.  Development  of  performance 
assessment  methodology  for  the  digital  avionics  information  system.  Dr.yton, 
Ohio:  Systems  Rc^eorch  Laboratories,  Final  Report,  1  December  1973  -  30  June 
1974,  August ,  1974, 


The  purpose  of  this  overall  effort  is  Co  develop,  instrument,  and  test  a  flexible 
aferiea  of  hitman  performance  assessment  meosv"  a  which  will  he  used  as  standard 
«vaiua*\1on  tiols  in  future  Advanced  digital  avionics  information  systems.  In 
order  to  meet  these  acquirements  a  primary  flying  task  was  simulated  on  an  IBM 
360-40  computer.  The  dynamics  of  this  simulator  resembled  those  of  a  lightweight 
fighter,  and  allowed  the  subject  to  control  all  ralevant  flight  parameters. 

Sever,  subjects  wetc  used  to  test  the  validity  of  four  secondary  tasks.  These  are 
(1)  the  Jex  tracking  task,  *x2)  the  Sternberg  tech’  "que  for  assessing  memory/ 
processing,  (3)  an  aye  movement  methodology,  an'  . .)  the  auditory  shadowing 
technique.  Analyses  were  designed  primarily  to  provide  information  on  the 
feasibility  of  using  these  taskr  as  secondary  workloads,  and  o;;  the  best  methods 
of  presenting  them  in  future  closed  loop  protocol  studies  of  DAT.S — like  systems. 
Results  indicate  that  all  of  the  methodologies  tested  are  feasible  and  should  have 
operational  validity  in  performance  assessment. 


W/L  Cat.  Code;  2.1.1,  2.2.5,  4.1.7 
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bpyket ,  D.A. ,  Stackhouse,  S.P.,  Khalafalia,  A.S.  and  McLane,  R.C.  Development 
of  techniques  for  measuring  pilot  workload.  Washington,  D.C.:  National 
Aeronautics  anJ  Space  Administration,  Contractors'  Report  NASA  CR-1888, 
November,  1971. 


The  goal  of  this  study  was  to  provide  an  objective  method  of  assessing  information 
workload  oased  on  physiological  met.  mrements.  Information  workload  >r  reserve 
capacity,  was  measured  using  a  visual  discrimination  secondary  task  and  subjective 
rating  of  task  difficulty.  The  primary  task  was  two  axis  tracking,  and  the 
independent  variables  in  this  study  were  aircraft  pitch  dynamics  and  wind  gust 
disturbances.  A  measured  workload  index  (MWI)  and  physiological  workload  index 
(PWI)  were  extracted.  An  important  measure  of  the  success  of  this  study  was  the 
degree  to  which  the  MWI  and  PWI  screed  across  the  243,  four-rainute  trials.  The 
electrophysiological  data  collected  included  vectorcardiogram,  respiration, 
electromyogram,  skin  Impedance,  and  electroencephalogram.  A  "best"  subset  of 
10  features  was  chosen  to  predict  the  three  measures  cf  reserve  capacity.  The 
cannonical  correlation  coefficient  was  .754  with  a  chi  squared  value  of  91.3 
which  allows  rejection  of  the  null  hypothesis  with  p  >.995. 
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Stackhouse,  S.  Workload  evaluation  of  LLNO  display.  Minneapolis,  Minnesota: 
Honeywell,  7201-3408,  October,  1973. 

The  objective  of  this  study  was  to  evaluate  concepts  which  were  represented  by 
particular  parameters  and  formats,  as  well  as  two  display  devices,  panel  CRT 
displays  and  a  helmet  mounted  disp]  y.  Both  simulator  and  inflight  helicopter 
evaluations  were  made.  The  variables  used  in  making  the  evaluation  were  chosen 
from  the  following  classes  of  data:  aircraft  state  variables,  secondary  task 
scores,  subjective  pilot  opinions,  and  physiological  features  derived  from 
the  electrocardiogram,  electromyogram,  respiration,  and  phonocardiogram.  A 
performance  measure  was  calculated  based  on  the  discriminatin'*  variables  related 
to  performance.  This  performance  estimate  of  how  well  the  subject-system 
performed  was  then  related  to  how  hard  the  subje»..-s  worked  to  process  the 
information  which  yielded  their  measured  performance.  This  latter  estimate 
was  bused  on  the  predictive  features  which  were  extracted  from  the  physiological 
measures . 
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Stackhouse ,  S.  P.  The  measurement  of  pilot  workload  In  manual  control  system. 
Minneapolis,  Minnesota:  Honeywell,  Inc.  F0398  I'Rl,  January,,  1^76. 

This  study  had  tvo  objectives:  1)  to  derive  and  validate  a  physiological 
workload  metric  using  an  adaptive  performance  measure  as  a  basis,  and  2)  to 
evaluate  tasks  of  differing  difficulty  in  two  experiments  -  precision  hover 
and  approach  to  landing.  Both  objectives  were  satisfied.  In  the  precision 
hovdr  experiment,  both  rthysiologicel  measures  and  performance  measures  were 
acquired.  The  physiological  measures  were  features  extracted  from  the  ECG,  two 
BMC  channels  (forehead  and  forearm),  and  breathing.  The  performance  measures 
were  ms  position  error  scores  and  a  time  delay  meas  ire  (At)  used  in  an  adaptive 
paradigm.  The  physiological  features  and  their  multiple  regression  coefficients 
which  best  predicted  the  performance  measures  were  determined.  The  coefficients 
were  then  applied  to  the  physiological  features  obtained  fron  the  approach  to 
landing  experiment. 
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Stackhouse,  S.  P.  Measurement  of  aircrew  information  processing  workload. 
Minneapolis,  Minnesota:  Honeywell,  Unpublished  manuscript..  1978. 

Pinysiological  measures  can  be  used  as  an  adjunct  to  performance  measures 
showing  not  only  how  well  the  man-system  performed,  but.  how  difficult  it  was 
for  the  man  to  perform  that  well.  Physiological  measures  are  especially 
sensitive  to  the  task  difficulty  levels  usually  found  In  flight  tests.  If 
task  difficulty  induced  changes  in  physiological  measures  generalize  (are 
not  specific  to  tynk>.  of  information  processing  task)  then  a  broadly  applicable, 
quantitative,  and  objective  systems  evaluation  method  will  be  available. 
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Stager,  P.  and  Muter,  P.  Instructions  and  information  processing  In  a  complex 
task.  Journal  of  Experimental  Psychology.  1971,  87,  291-294. 

Two  experiments  Involved  a  decision  task  with  a  static  display  analogue  of  a 
radar  display  similar  to  that  used  in  air  traffic  control.  The  Ss  were 
required  to  detect  potential  collision  situations  in  a  sequence  of  independent 
displays.  Following  an  earlier  study,  Ss  in  both  experiments  either  (a)  were 
trained  entirely  with  pictorial  displays  and  provided  with  assumptions  involved 
in  constructing  the  air  traffic  situations,  or  (b)  were  initially  trained  with 
displays  containing  verbal  descriptions  of  possible  situations  and  not  given 
underlying  assumptions.  In  Exp.  I,  a  secont ary  loading  task  was  performed 
concurrently  with  the  decision  task.  In  Exp.  II,  Ss  were  required  to  analyze 
both  redundant  and  nonredundant  displays.  Results  Indicated  that  the  procedures 
acquired  by  pictorially  trained  Ss  were  less  susceptible  to  processing  overload 
and  that  an  additional  performance  advantage  derived  from  their  use  of  redundancy 
in  the  displays. 

W/L  Cat.  Code:  2.2.1 
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Stager,  P.  and  Zufelt,  K.  Dual-task  method  in  determining  load  differences. 
Journal  of  Experimental  Psychology.  1972,  94,  113-115. 

In  two  previous  studies,  differences  in  information  processing  in  a  complex 
decision  task  have  been  reported  to  depend  on  the  training  instructions. 

Group  differences  in  the  susceptibility  to  processing  overload  and  the  use 
of  task  redundancy  have  been  specified.  The  present  study  attempted  to 
evaluate  the  observed  differences  in  a  dual-task  situation.  The  Ss  were 
required  to  perform  the  complex  decision  task  and  a  keeping-track  task 
concurrently.  It  was  hypothesized  that  performance  on  the  subsidiary 
keeping-track  task  would  be  an  inverse  function  of  the  instructions-induced 
load  of  the  decision  task.  Significant  differences  between  groups  were 
obtained  on  the  decision  task,  but  there  were  no  differences  in  subsidiary 
task  performance.  The  discussion  concerned  the  limited  capacity  model  and 
the  value  of  assessing  apparent  differences  in  processing  or  task  load  by 
means  of  a  dual-task  situation. 
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Stanford,  B.  A.  Validity  and  raliabllity  of  aubjcctiva  ratings  of  perceived 
exertion  during  work.  Ergonomics ,  1976,  19,  53-60. 

The  purpose  of  the  present  investigation  was  to  determine  the  reliability  of 
the  Borg  (R??)  Scale  under  a  variety  of  experimental  conditions.  Fourteen 
sedentary  female  subjects  performed  six  repeated  work  tasks  (12  in  ell) 
distributed  over  four  experimental  testing  sessions  and  presented  in  a  randomised 
order.  Work  tasks  Involved  treadmill  walking  and  jogging,  cycling,  and  stool 
stepping.  Workloads  were  presented  in  progressive  (step-wise),  oscillating, 
or  single  load  submaxlmal  intensities.  During  work,  heart  rate  (HR)  was  recorded 
at  regular  Intervals  And  ratings  of  perceived  exertion  (KPE)  were  elicited  either 
at  regular  intervals  (interval)  or  only  during  the  final  minute  of  work  (terminal). 
RPE  responses  were  found  to  be  highly  reproducible  whether  interval  or  terminal. 
High  correlations  were  alsc  found  between  interval  and  terminal  RPE  responses. 

RPE  demonstrated  a  strong  relationship  with  HR  and  work  intensity.  It  was 
concluded  that  category  ratings  of  perceived  exertion  according  to  the  Borg 
(RPE)  Scale  offer  a  sensitive  and  reliable  measure  of  stress  encountered 
during  work. 

W/L  Cat.  Code:  1.1 

Op .  Behav .  Code :  4 . 1 

Opinion  Rating  scale  Experimental  Laboratory  Flight  simulator 

Flight  test 


- -  -  C..W4 miflHf'laa  n-Hnf  urirklnurf  in 

)  XV  •  W4.  **;  *«p  1 -----  — - r - - -  - 


r*e-  .,4  V 


aus.1 -  — y o  i - - * 

the  operation  of  a  short  haul  Jet  transport  aircraft.  Proceedings  of  AGARD 
Conference  on  Studies  on  Pilot  Workload,  AGARD-CPP-217,  April,  1977,  Bll-1. 


A  representative  sample  of  pilots  employed  by  an  airline  operating  a  short  haul 
jet  transport  aircraft  assessed  the  acceptability  of  the  cockpit  layout  and 
instrumentation,  the  handling  quality,  and  the  feasibility  of  the  system  operation 
in  regard  to  the  pilots  workload.  The  assessment  consisted  of  two  parts:  l)  a 
questionnaire  of  82  fixed  items,  answered  on  a  7  step  rating  scale.  2)  a  semi- 
structured  interview  concerning  19  items.  Critical  points  and  favorable 
capabilities  of  the  man-machine-system  can  be  evaluated  economically  and 
objectively  if  the  following  conditions  are  met:  carefully  chosen  questionnaire 
and  interview  strategy,  a  well  established  rating  scale,  and  a  sufficient  sample 
of  subjects  for  statistical  reliability  of  the  data. 
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Steininger,  K.  and  Wistuba,  C.  Mlni«ua  f ligrt  crew  of  transport  aircraft. 
Mathoda  for  aaasurlng  workload  of  flight  crawa.  Hamburg,  West  Geraarty: 
Deutsche  Forschungs-und  Versuchsanatatt  fuer  Luft-und  kaunfahrt,  Report  No. 
DLR- IB-355-74/3,  1974.  (In  German). 

Objective  quantitative  catiwatiin  of  pilots'  workload  considering  the  present 
state  of  measurement  and  knowledge  la  discussed.  Pilot  workload  is  an 
essential  criterion  for  defining  minimum  flight  crew  in  civil  transport 
aviation.  Best  proved  methods  are  selected,  Including  time  and  motion 
studies,  flight  performance  and  psychologies!  measurements ,  and  measurement 
of  reserve  capecity.  It  is  expected  thet  eur.h  studies  will  Improve  human 
engineering  end  operational  organisation. 
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Stephens,  B.W.  and  Michaels,  R.M.  Timesharing  between  two  driving  tasks: 
Simulated  steering  and  rer.ogni.tlon  of  road  signs.  Paper  presented  at  the 
43rd  Annual  Meeting  of  the  Highway  Research  Board,  Washington,  D.C.,  January, 
1964. 


This  study  was  designed  to  determine  general  driver  ability  to  steer  a  vehicle 
while  simultaneously  searching  for  a  specific  sign  and  to  measure  the  timesharing 
basis  used  in  performing  the  two  tasks.  Analyses  were  conducted  to  determine: 

(1)  the  influence  of  constituents  of  the  tracking  task  upon  performance  of  the 
search-and-recognition  task,  and  (2)  the  influence  of  components  of  the  search- 
and-re cognition  task  upon  tracking  performance.  Integrated  tracking  error  variances 
were  analyzed,  as  were  the  recognition  time  variances  for  each  of  the  conditions 
associated  with  the  dynamic  recognition  task.  In  the  secoid  kind  of  analysis, 
basic  to  the  inquiry  was  a  test  of  a  generalized  timesharing  hypothesis,  which 
states  that  there  is  a  trade-off  between  the  two  tasks.  The  erroneous  recognition 
of  aigne  presented  was  examined  in  the  third  kind  of  analysis.  The  fourth  kind 
of  analysis  was  made  of  control  tests  that  were  conducted  to:  (1)  ascertain  tne 
possible  effects  of  learning  occurring  throughout  the  experiments,  and  (2)  make 
a  comparison  of  experimental  and  baseline  test  conditions  in  which  the  tracking 
tasks  and  sear ch-and- recognition  tasks  were  presented  cingly.  In  all  comparisons 
of  the  independent  tasks  and  their  timeshared  counterparts,  the  y  trformance  of 
test  operators  deteriorated  when  the  tasks  were  shared. 


W/L  Cat..  Code: 

Op.  behav.  Cede: 
Spare  m.  capacity 
Primary  task 


2.2.1,  2.2.2 

1. ,  2. ,  4. 

Subsidiary  task  Experimental 
Single  measures 


Laboratory 


Flight  simulator 
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Sternberg,  S.  High-speed  scanning  in  hisun  memory.  Science,  1966,  153,  652-654. 
(See  also  P.  N.  Haber  (Ed.)  Visual  perception.  New  York:  Holt,  Rinehart  and 
Winston,  1969,  226-230.) 

'Than  subjects  judge  whether  a  test  symbol  is  contained  in  a  short  memorized 
sequence  of  symb-la,  their  mean  reaction-time  increases  linearly  tilth  the 
length  of  the  sequence.  The  linearity  end  slope  of  the  function  Imply  the 
existence  cf  an  lntarnal  serial-comparison  process  whose  average  rate  is 
between  25  and  30  symbols  per  second. 

W/L  Cat.  Code:  2.2.1,  .3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  Laboratory  Background 

Primary  teak  Single  measures  Experimental 


Stone,  L.  W. ,  Sanders,  M.  G. ,  Click,  D.  D. ,  Wiley,  R.,  and  Kimball,  K.  A. 

A  human  parforu.«*nce/workload  evaluation  of  the  AN/PVS-5  bifocal  night 
vision  goggles.  Fort  Rucker,  Alabama:  U. S.  Army  Aeromedlcal  Research 
Laboratory,  USAAKL  Report  No.  79-11,  July,  1979. 

Eight  experienced  US  Army  aviators  performed  various  maneuvers  in  an  instrumented 
helicopter  to  test  the  relative  usability  of  two  bifocally  configured  night  vision 
goggles.  Both  conf igurationa  were  statistically  better  than  the  unmodified 
arrangement  when  looking  at  n  pilot's  ability  to  hold  a  precise  altitude  at  night. 
The  subjective  data,  supported  by  flight  performance  observed  between  the  two 
bifocals,  further  suggested  that  a  24%  bifocal  version  was  more  desirable  than  a 
14%  configuration  The  Inference  is  that  the  reduced  inside  field-of-view 
presented  by  the  14%  bifocal  interfers  with  a  pilot's  ability  to  rapidly  locate 
instruments  once  he  han  directed  his  attention  inside  vhe  cockpit. 

W/L  Cat.  Code:  1.1,  1.2,  3.1 

Cp.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  test  Flight  simulator 

Primary  task  Questionnaire  Flight  test 

Single  mcas'tras 
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Jeon,  W.  F,  end  Hapenney,  J.  D.  Mission-crew  fatigue  during  rivet  joint 
operations.  Erooka  A? A,  Taxes:  USA?  School  of  Aaroapaca  Hadicina, 
SAM-TR-76-36,  September,  1976. 

Subjective  fatigue  and  sleep  data  ware  collected  fro*  a  USAF  Security  Service 
airborne  mission  team  before  and  durirg  oi>  airborne  mission.  The  primary  purpose 
of  the  test  vas  to  refine  the  procedures  and  analytical  techniques  in  preparation 
for  an  upcoming  demonstration/evaluatlon  of  a  new  and  modernised  system.  Results 
indicated  that  only  minor  changes  in  procedures  and  techniques  were  necessary. 

The  data  also  provide  unique  baoellne  information  for  future  comparison  and 
evaluation  of  similar  data  from  the  modernised  system. 

W/L  Cat.  Code:  1.1,  4,1.12 

Op.  Behav.  Code:  1. ,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Flight  test  Flight  simulator 

Physiological  Body  fluid  Flight  test 

anal. 


Storm,  H.  F. .  Hartman,  B.  0.,  Intano,  G.  ?.  and  Peters,  G.  L.  Endocrine- 
metabolic  effects  in  short-duration  Uigh-vorkload  missions:  Feasibility 
study.  Brooke  AF3,  Texas:  USAF  School  of  Aerospace  Medicine,  SAM-TR-76-30, 
August ,  1976. 

A  study  wee  conducted  at  the  USAF  Instrument  Flight  Center  to  test  an  augmented 
assembly  of  measures  for  assessing  the  relative  merits  of  various  flight 
instrumentation  systems.  The  USAF  School  of  Aerospace  Medicine  (SAM)  stress 
battery  was  Included.  Although  the  study  was  not  designed  so  as  to  permit  an 
optimized  evaluation  of  the  SAM  etress  battery,  the  following  results  were  noted: 
anticipatory  streso,  mild  flight  stress,  and  no  habituation  across  missions. 

The  SAM  battery  appears  to  be  a  useful  addition  to  the  flight  instrumentation 
research  program. 

W/L  Cat.  Code:  1.1,  2.2.1,  4.1.12 

Op.  Benav.  Code:  1.,  2.,  3.,  4. 

Opinion  Rating  scale  Experimental  Flight  test  Flight  simulator 

Spare  m.  capacity  Subsidiary  task  Flight  test 

Physiological  Body  fluid 

unal. 
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Strasaer,  H.  Work-phyaio logical  investigation*  for  the  objoctivizatlon  of  the 
tracking  behavior,  the  Mental  load,  and  Its  psychopharaacological 
mod ul ability,  Doctoral  dissertation,  Muenchen  (Munich)  Techniache 
tJhlvaraitaet,  1972.  (In  German.) 

Problems  connected  with  the  integration  of  man  in  the  technological  environment 
are  examined,  giving  attention  to  danger*  connected  with  the  monotony  end  the 
aental  atreaa.  A  theoretical  analysis  of  test-connected  relations  If  conducted, 
tasking  into  account  a  cybernetic  analysis  of  the  factor  'uian. '  an  analysis  of 
technical  factors  involved  in  control  and  guidance  activities,  aspect  of  psy¬ 
chophysical  performance  end  mental  load.  Approaches  and  equipment  needed  for  the 
experlMcnt*7  investigation*  are  discussed  together  with  model  concepts  concerning 
physiologies.*  changes  under  mental  stress,  the  effect  of  stimulants  on  performance, 
effects  produced  by  tranquilizers,  the  Influence  of  alcohol  on  tracking  per¬ 
formance,  end  testa  involving  psychopharaacologlcal  agents. 

W/L  Cat.  Code:  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Nath,  model  Construct  None  Background 


Straseer,  H.  Heart  rate  and  sinusoidal  arrhythmia  measurement  in  view  of 
objectivatlng  concentration  and  stress  in  control  tasks.  In  DGLR  New  or 
Newly  Tested  Methods  *or  the  Assessment  of  Pilot's  Workload,  1974.  (Munich, 
Weat  German,  In  Germ e  .) 

Mental  effort  during  control  tasks  such  as  pursuit  tracking  tests  was  correlated 
with  heart  rate,  low  frequency  arrhythmia,  ar.d  high  frequency  sinus  arrhythmia 
profiles  monitored  for  several  hours.  Results  show  that  pulse  frequency  and 
sinusoidal  arrhythmia  appear  in  a  somewhat  reciprocal  relation.  Sinus  arrhythmia, 
though  varying  greatly  among  individuals,  is  a  reliable  parameter  which  provides 
supplementary  information  when  test  linked  factors  cease  to  show  up  In  pulse 
frequency. 

W/L  Cat.  Code:  3.1,  4.1.10 

Op.  Behav.  Code;  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 

Physiological  Heart  rate, 

h . r .  var . 


2?2 


SY-27A-S0 


Strasser ,  H.  Physiological  wuurti  of  workload®:  correlations  batwean 
physiological  parameters  and  operational  performanca.  Proceedings  of  the 
A  CARD  Conference  on  Methods  to  Assess  Workload,  AGARD-CP-216 ,  April,  1977, 

A8-1  -  A8-3. 

The  influence  of  different  hypoxic  gas  mixtures  on  pursuit  tracking  and  on 
physiological  parameters  was  studied.  The  following  conclusions  are  drawn. 

Already,  in  restively  mild  hypoxia,  phyaiological  changes  are  present,  but 
norrwlly  were  concealed  by  reactions  due  to  prolonged  test  time.  In  spite  of 
statistically  significant  physiological  effects,  no  noticeable  deterioration  of 
performance  in  tracking  was  measured  in  hypoxia  down  to  a  hypoxic  gas  mixture 
of  only  13%  02  in  inspired  air.  Not  isitil  before  11%  02  significance  and 
mentlonable  impairments  of  tracking  performance  were  found.  The  same,  shown  for 
hypoxia,  is  true  of  noise.  Decreased  performance  in  noise  was  not  found,  but 
an  increased  level  of  heart  rate  indicated  the  stress.  Physiological  indicators 
definitely  react  in  a  low  workload  situation  to  bring  in  action  reserves  of  energy. 

W/l»  Cat.  Code;  3.1,  4.1.10 

Op.  Bahav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 


Physiological  Heart  rate , 

h . r .  var. 


»*  ...  .  1  \ 

noi*y  vc.u  .j 


Strasser,  H.  Measurement  ot  mentaj.  worxioaa.  in  n. 

its  theory  aid  measurement.  New  York:  Plenum  Press,  1979,  345-348. 


This  paper  provides  a  brief  sunmary  of  applications  problems  not  currently 
receiving  attention  by  workload  researchers.  Some  of  the  problems  described 
are:  underloading,  reliability  and  validity  of  workload  measures,  extrapolation 
of  laboratory  studies  to  field  applications,  and  adaptation  effects  on  workload 
measurement. 


W/L  Cat.  Code:  3.3,  4.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Priraary  task  Math,  modeling  Critique  None  Background 

Physiological  Single  measures 
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Strasser,  H. ,  drilling,  G,v  Klinger,  K,  P  ,  and  Mueller-Limnroth,  W. 

Physiological  and  operational  atate  c  '  a  group  of  aeroplane  pilots  under 
the  conditions  of  stressing  cracking  tasks.  Aerospace  Medicine,  1973,  44, 
1040-1047. 


A  test  set-up  is  described,  with  which  a  picture  of  the  operational  and  physiological 
state  of  a  group  of  pilots  during  a  period  of  about  2  hours  was  obtained.  The 
remilts  recorded  for  fucking  performance  with  both  fixed  and  adaptive  self- 
adjusting  degrees  of  difficulty,  together  with  the  simultaneous  recording  of  the 
heart  rate,  sinus  arrhythmia,  and  acoustically  evoked  potentials,  were  compared 
with  the  figures  obtained  from  a  control  group.  Through  the  combination  of  the 
parameters  measured  it  could  be  demonstrated  that  the  group  of  pilots  had  an 
above-average  level  of  performance  in  the  tracking  tests,  as  well  as  a  high 
capacity  for  prolonged  mental  concentration.  A  relatively  small  acute  alcohol 
effect,  which  cannot  be  separated  from  the  natural  effects  of  training  by  means 
of  the  operational  data,  is  clearly  shown  in  the  parameter  of  evoked  potentials 
that  describes  information  processing  by  the  central  nervous  system. 


W./L  Cat.  Code: 


3.1,  4.1.6,  4.1.10 


Op.  Beh&v.  Code: 


1. ,  2.  ,  3. ,  4. 


Primary  task 
Physiological 


Single  measures  experimental  Laboratory  Flight  simulator 
ECP 

Heart  rate, 
h.r.  var. 


Street,  K.  L. ,  Singh,  H.  and  Hale,  P.  N.,  Jr.  The  evaluation  of  mental  stress 
through  the  analysts  of  parotid  fluid.  Human  Factors,  1970,  12,  453-455. 

This  study  investigates  the  utilization  of  the  17-hydroxycorticostericd  (17- 0HCS7 
level  in  the  parotid  flui*  as  a  measure  of  mental  or  emotional  stress.  Twelve 
graduate  students  were  subjected  to  three  levels  cf  mental  stress,  and  the 
results  of  the  chemical  analysis  cf  the  parotid  fluid  indicate  that  there  is  a 
definite  relationship  between  mental  or  emotional  stress  and  the  17-ORCR  level. 

W/L  Cat.  Code:  4.1.12 


Op.  Behav.  Cede:  1  ,  2.,  4. 


Physiological 

Body  fluid 

Experimental 

Laboratory 

Flight  simulator 

anal. 

Flight  test 
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Stress  it-  Air  Traffic  Control  Research  Association,  International  Symposium  on 
Objective  Assessment  of  Work  Load  in  Air  Traffic  Control  Tasks,  Technische 
Ijniversitaet  Darmstadt,  Darmstadt,  West  Germany,  June  1971,  Proceedings. 
Ergonomics .  1971,  14. 


Objective  research  methods  and  results  are  described  relative  to  tie  determination 
of  the  stress  of  work  tasks  performed  by  air  traffic  controllers.  Procedures 
and  equipment  fcr  determing  individual  capacities  are  explained,  together  with 
approaches  for  correlating  stress  and  strain.  Topics  examined  include  criteria 
for  evaluating  ATC  systems,  analysis  of  mental  processes  in  ATC,  variation  of 
operator  strategies,  ergonomics  measurements,  hardware  and  software  problems 
in  workload  analysis,  use  of  subjective  ratings,  attitudes  of  operators  to  work 
and  working  conditions,  and  the  use  of  simulators  in  testing  both  individual 
capacity  and  system  models. 


W/L  Cat .  Code : 

Op.  Behav.  Code: 
Opinion 

Spare  m.  capacity 
Primary  task 
Physiological 


1.1,  2.1,  3.,  4.1 
1. ,  2. ,  3. ,  4. 

Multiple  Review 

Construct 

Experimental 


Laboratory 

Field 


Flight  simulator 
Flight  test 


1 

1 

1 


I 


Strieb,  M.  I.  The  human  operator  simulators  v6l»a»i<s  I:  Introduction  and 
overview.  Willow  Grove,  Pennsylvania:  Analytics,  August,  1975. 

The  Human  Operator  Simulator  (HOS)  is  a  computer  simulation  of  a  human 
Being  in  a  goal-oriented  task  processing  environment.  To  facilitate  the 
entry  of  the  tusk  and  environment  descriptions  into  HOS,  the  Human 
Operator  Procedures  Language  (HOPROC) ,  an  English-like  meta-language 
was  developed.  HAL,  the  HOPROC  Assembler /Loader,  processes  HOPROC 
Statements  and  compiles  them  into  a  series  of  pseudo-machine  instructions 
for  use  by  HOS.  During  the  execution  of  HOS,  each  of  the  HOPROC  macro¬ 
level  instructions  are  translated  into  micro-level  actions  which  are 
interpretable  by  the  Human  Operator  Data  Analyzer/Collator  (HODAC)  into 
body  motion  statistics,  information  absorption  statistics,  etc.  This 
volume  presents  an  overview  and  rationale  for  HOS,  and  is  the  first  of 
a  series  providing  complete  documentation.  Volume  II  is  a  user's  guide 
for  HOS,  Including  the  HOPROC  language.  Volumes  III,  IV  and  V  contain 
programmer's  guides  for  HaL,  HOS,  and  HODAC  respectively.  This  volume 
makes  obsolete  Analytics'  Technical  Report  1046-K. 

W/L  Cat.  Code:  2.1.1,  2.2.1,  2.2.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  oak  cotap..  Experimental  Laboratory  Flight  simulator 

Mme  assess. 

Subsidiary  task 
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Strieb,  M.  1.  „  Glenn,  F.  A.,  Fisher,  C.  end  Fitts,  L.  B.  Chapter  VII  from 
the  human  operator  simulator,  volume  VII:  LAMPS  air  tactical  officer 
simulation.  Willow  Grove,  Pennsylvania:  Analytics,  November,  1976. 

The  HOS  display  and  control  taxonomy  and  task  taxonomy  are  models  that  influence 
and  must  be  evaluated  separately  from  the  dynamic  performance  models  for  which 
they  structure  the  inputs  and  outputa.  The  procedure  multiplexing  model  is 
the  protocol  by  which  the  simulated  operator  schedules  the  execution  of  his 
various  tasks.  These  models  and  how  they  evolved  are  described  herein.  The 
anatomy  movement  models  describe  the  functional  assignment^  of  body  parts 
and  the  dynamic  response  characteristics  for  each  body  part.  These  are  also 
presented.  Finally,  a  detailed  description  of  the  structure  of  the  perception, 
memory,  nnd  mental  computation  models  is  presented.  These  are  the  models  of 
the  operator's  cognitive  processes  as  represented  in  HOS.  They  describe  how 
the  operator  functions  as  an  information  processor.  * 

W/L  Cat.  Code:  2.1.1,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Task  comp..  Construe:  None  Flight  simulator 

Primary  task  time  assess. 

Math,  tnodnl 


Strieb,  M.  I.  and  Harris  R.  Sensitivity  analyses  for  cost  effectiveness  of 
F-3C  SS-3  operator  station:  the  human  operator  simulator,  vol.  X-part  2. 
Willow  Grove,  Pennsylvania:  Analytics,  Technical  report  1330,  October  2b, 
1978. 

This  report  documents  a  series  of  sensitivity  analyses  that  have  been  performed 
on  the  data  generated  from  a  simulation  of  the  functions  of  the  Sensor  Station  3 
(SS-3)  operator  onboard  the  Navy's  P-3C  Orion  anti-submarine  warfare  (ASW)  patrol 
aircraft.  The  sensitivity  analyses  are  an  outgrowth  of  an  intial  study  that 
examined  the  SS-3  operator's  performance  in  three  alternative  crewstation  config¬ 
urations  on  the  P-3C  and  under  a  degraded  mode  of  operation.  The  study  used  the 
Human  Operator  Simulator  (HOS)  to  simulate  the  functions  of  the  SS-3  operator 
in  several  different  crewstation  configurations.  Measures  of  overall  system 
performance  were  then  applied  to  the  simulation  results  to  determine  the  relative 
effectiveness  of  each  configuration.  The  data  were  then  used  to  determine  the 
cost  effectiveness  of  each  configuration. 

W/L  Cat.  Code:  2.1.1,  3.1 

Op.  Behav.  Code:  1*,  2.,  : * ,  4. 

Spare  m.  capacity  Task  comp..  Experimental  Laboratory  Flight  simulator 

time  Assess. 

Primary  task  Math,  model 
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Strieb,  M.  I, ,  Pros ton,  J.  F. ,  III,  Harris,  R. ,  and  Fisher,  C.  Weapon  system 
economic  ana lysis- the  human  operator  simulator,  volume  VIII.  Willow  Grove, 
Pennsylvania:  Analytics,  TR  1289  March  27,  1973. 

The  Human  Operator  Simulator  (HOS)  is  a  digital  computer  simulation  of  the 
-  >rformance  of  an  operator  in  a.  goa.l-oriented,  task-processing  environment.  This 
jport  describes  a  study  whose  purpose  was  to  determine  the  feasibility  of  using 
HOS  to  assess  tha  impact  of  alternative  crewstation  designs  on  total  system 
performance  and  hence  the  cost  effectiveness  of  alternative  crewstation  con¬ 
figurations.  The  P-3C  Sensor  Station  3  (non-acoustic)  operator  station  was  used 
as  the  testbed  for  this  study.  The  simulations  modr'.Ted  the  SS-3  operator’s 
performance  during  a  reconn&issan.'.n  mission  similar  to  those  currently  flown  in 
the  Mediterranean.  This  volume  is  the  eighth  in  a  series  providing  complete 
documentation  on  HOS. 


W/L  Cat.  Code: 

1.2,  2.1.1,  3.3 

Op.  Behav.  Code: 

1.,  2.,  3.,  4. 

Opinion 

Quest ionnalre 

Construct  Si’aulstor 

Flight  simulator 

Spare  m.  capacity 

Primary  task 

Tank  eemp . , 
time  assess. 
Math .  model 

Experimental 

Strother,  D.  u.  Visual  activities  of  the  helicopter  pilot  during  lew-altitude, 

VFR  flight.  Aircrew  performance  in  army  aviation.  Proceedings  of  a  conference, 
27-29  November,  1973.  U.S.  Army  Aviation  Center,  Fort  Rucker,  Alabama,  1974, 
188-192. 


This  paper  addressees  a  vital  problem  cf  very  lew  altitude  flight  missions.  The 
problem  involves  the  visual  capabilities  of  the  helicopter  pilot  during  low 
altitude,  71 R  flight.  It  may  be  defined  as  establishment  of  the  pilot’s  visual 
workload.  The  urgency  of  this  problem  stems  from  the  trend  to  add  to  the  pilot’s 
existing  tasks.  He  is  now  asked,  in  fighter  and  scout  helicopters,  to  perform 
two  new  tasks:  (1)  to  increase  his  surveillance  activities  in  the  target  area 

since  the  gunner  is  becoming  &  head-down  crew  meuibei  during  attack  and  search 
mlsuiou  phases,  and  (2)  to  act  as  a  substitute  manner  by  using  a  helmet  mounted 
sight  and  a  headtracker.  These  tasks  must  be  performed  in  addition  to  nap-of-the- 
earth  flight.  Continuing  studies  must  define  the  time  required  of  these  additional 
tasks  so  that  the  time  required  can  be  matched  with  the  time  available.  Any 
overburdening  of  the  pilot  must  be  addressed  by  tactical  and  operational  planners. 


W/L  Cat.  Code:  3.1,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Primary  task 
Physiological 


Single  measures  Construct  Flight  test 

Eye  movement  Experimental 


Flight  simulator 
Flight  test 


297 


SY-27R-80 


Gtrothet,  D  D.  Visual  and  manual  workload  of  the  helicopter  pilot.  Paper 
p resent ud  at  the  Annual  Rational  Povua  of  the  American  Helicopter  Society, 
Washington,  D.C.,  Kay,  1974.  (Preprint  No.  321). 

The  total  workload  of  the  helicopter  pMot  includes  many  fcrr.i  cf  huivsn  activity! 
manipulation,  vision,  audition,  cognition.  The  summation  of  the  activity  in 
each  of  theae  nay  On  considered  the  votal  pilot  workload.  Two  facauc  of  the 
total  pilot  workload  are  discussed  in  this  paper.  The  first  addresses 
manipulative  workload  during  single-pilot  actual  instrument  flight  In  a  high 
density  zona.  Data  indicate  the  helicopter  pilot  has  ample  time  to  perform 
his  required  manipulative  tasks.  The  second  discusses  visual  workload  and  an 
experimental  technique  for  measuring  this  load.  Data  are  presented  which 
indicate  an  interaction  of  visual  workload  with  altitude.  Human  Factors 
Engineering  depends  on  an  abilivy  to  predict  pilot  performance  in  order  to 
design  optimal  cockpits.  Indices  of  the  pilot  workloads  discussed  are 
critical  during  the  iterative  process  of  design. 

W/'L  Cat.  Code:  2.1.1,  2-2.1,  3.1,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare,  m.  capacity  Task  coo  Construct  Flight  test  Flight  simulator 

time  assess. 

Primary  task  Subsidiary  teak  Experimental  Flight  test 

Physiological  Single  measure 

Eye  movement 


Sun,  P.B.,  Keane,  W.P.  and  Stackhouse,  S.P.  The  measurement  of  pilot  workload  in 
manual  control  systems.  Proceedings  of  Aviation  Electronics  Symposium, 

Fort  Monmouth,  New  Jersey,  April,  1976. 

The  objective  of  thio  study  was  to  measure  noth  performance  workload  and 
physiological  workload  in  a  hover  simulation  and  ts.  apply  the  derlvad  weighting 
coefficients  for  sume  of  the  physiological  variables  to  those  same  physiological 
measures  made  In  a  simulated  decelerating  landing  experiment.  The  primary  objective 
was  methodological.  That  is,  could  physiological  variables  be  osud  tc  measure 
workload  during  transient  maneuvers  when  the  werighting  coefficients  for  these 
variables  ware  derived  from  their  relationship  to  an  adaptive  ~«rforuAnce  measure 
obtained  during  a  steady  atate  maneuver  such  as  precision  hover?  A  further 
objective  of  this  study  was  to  evaluate  three  combinations  of  control  system 
feedback  with  three  quantities  tc  compare  workload  dcriug  r  decelerating  approach 
to  lending. 


W/L  Car.  Code; 
0,n  Behav.  Cods: 


2.2.4,  2.3.5,  3.2,  4.1.3,  4.1.4,  4.1.11 
1.,  2.,  4, 


Spare  m.  capacity  Multiple  Experimental  Flight  simulator 

Primary  task 

Physiological 


Flight  simulator 
Flight  test 
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Sundermeyer ,  P.  and  Alles,  W.  The  influence  of  the  xa*vunt  of  eutonatlon  in 
a  flight  path  guidance  system  on  flight  path  deviation  and  pilot  work  load. 
Paper  presented  at  Symposium  ueber  Fllegen  im  FIughafen-N^hberelch, 

Hamburg,  West  Germany,  April,  1979.  (In  German.) 

Attention  is  given  to  simulations  carried  out  to  investigate  the  delegation  of 
duties  between  the  pilot  and  autopilot  by  determining  the  effect  of  the  amount 
of  automation  on  flight  path  accuracy  and  pilot  work  load.  Three  steps  of 
automation  are  studied:  (1)  flight  path  guidance  with  autopilot  control,  (2) 
flight  path  qui dance  with  Information  relay  to  the  control  elements,  and  (3) 
fully  automatic  flight  path  guidance.  It  was  found  that  flight  path  accuracy 
improved  ti  rough  a  vertical  speed  error  reduction  of  2 OX  for  step  2,  end  25X  for 
step  3.  In  addition,  course  errors  were  reduced  10  and  25X,  respectively. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Single  measures  Experimental  Flight  simulator  Flight  simulator 

Flight  test 


Sverko,  B.  Individual  differences  in  time  sharing  performance.  Urbana- 
Champaign,  Illinois:  Aviation  Research  Laboratory,  Technical  Report, 

ARL-7 7-4/ AFOSR-7 7-4 ,  January,  1977.  (AD  A043  525). 

Experiments  In  time-sharing  ability  were  performed.  Four  tasks  were  used:  (1) 

The  rotary  pursuit  task;  (2)  The  digit  processing  task;  (3)  The  mental  arith¬ 
metic  task;  and  (4)  The  auditory  discrimination  task.  Sixty  subjects  performed 
the  tasks  several  times  singly,  one  by  one,  as  well  as  concurrently,  in  all 
possible  two-cask  combinations.  Sixteen  scores  were  obtained  for  every  subject: 
performance  on  each  task  when  performed  singly,  as  well  as  when  performed 
concurrently  with  each  of  three  other  tasks.  These  1'  variables  were  intercorrelated 
and  the  resulting  matrix  of  interr.orrelatlons  was  submitted  to  a  factor  analysis. 

Only  task-specific  factors  were  identified.  No  evidence  for  a  time-sharing  factor, 
which  would  account  for  concurrent  task  performances,  was  found.  Thus,  the 
notion  of  "ti.:.e-fiharing  ability"  was  not  supported. 

W/L  Cat.  Code:  2.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 
Primary  task  Single  measures 
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Szekely,  J.  Evaluation  of  mental  load  in  the  study  and  design  of  work 
conditions  - theory,  measurement,  application.  Institute  National  de 
Recherche  et  de  Securite.  Peris,  Notes  Scientifiques  et  Techniques  de 
1’INRS,  No.  4,  January,  1975.  (In  French.) 

This  epcrt  examinee  developments  in  the  assessment  of  mental  load  in  the 
industrial  context.  The  literature  is  reviewed  and  an  attempt  is  made  co 
clarify  the  concept  of  mental  load  in  ergonomic  terms.  The  chief  methods  of 
measuring  mental  load  are  reviewed,  and  the  practical  possibilities  of  applying 
these  methods  are  examined. 

W/L  Cat.  Code:  1.,  2.,  3.,  4. 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Opinion  Multiple  Review  None  Background 

Spare  m.  capacity 
Primary  task 
Physiological 


Telchgraber,  W.  M.  The  effects  of  signal  quantization  on  compensatory  tracking 
performance.  Unpublished  master's  thesis.  Naval  Postgraduate  School, 
December,  1972.  (AD  756  680). 

The  effects  of  quantizing  the  displayed  error  were  investigated  in  ctirh 
single-  and  dual-axis  critical  compensatory  tracking  tasks  and  in  cross- 
adaptive  tracking  tasks.  Both  first  order  and  second  order  controlled 
elements  were  used,  as  veil  as  an  intermediate  "1.5"  order  element. 

Quantization  intervals  Investigated  ran  from  0  to  1.69  cm  on  a  10  cm  by 
10  cm  display.  A  digital  computer  program  was  written  for  use  with  a 
hybrid  computer  in  order  tc  mechanize  the  various  types  of  tracking  tasks 
used  in  this  research  and  for  future  use  at  this  facility.  Results  of  the 
critical  tracking  task  runs  indicate  that  the  operator's  performance 
deteriorates  almost  linearly  as  the  quantization  interval  is  Increased. 
Cross-adaptive  tracking  task  results  indicate  a  pronounced  increase  in 
operator  workload  wh&n  quantization  is  used. 

W/L  Cat.  Ccu  :  2.2.5,  3.1 

Op.  Behav.  Code:  1. ,  2. ,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 
Primary  task  Single  measures 
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Teiger,  C.  Regulation  of  activity:  an  analytical  tool  for  studying  work-load 
in  perceptual  actor  tasks.  Ergonomics .  1978,  21,  203-213. 

Worlc-lc ad  imposed  c.  the  operator  performing  perceptual-motor  tasks  subject 
to  rigid  time-constraints  auy  be  analysed  by  Investigating  methods  of 
regulation  between  various  psychophyslologlcal  functions.  This  is  particularly 
true  for  the  study  of  relationships  between  operating  methods  and  postural 
activity,  and  also  by  the  change  In  these  relationships  over  time.  Thus  we 
appear  to  have  a  method  for  analysis  of  external  and  internal  constraints  bn  the 
operator,  additional  to  the  tool  for  evaluating  the  physiological  cost  entailed 
in  meeting  work  demand,  provided  by  the  E.M.G.  Results  are  presented  from 
industrial  studies  of  electronic  component  assembly  and  contrasted  with 
laboratory  findings.  Combination  of  the  two  types  of  study  is  seen  to  be 
necessary  and  important  for  analysis  of  workload. 

W/ L  Cat.  Code:  2. ,  4. 

Op.  Behav.  Code:  4.1. 4 

Physiological  KMG  Review  Field  Flight  simulator 

Flight  test 


Teptr,  G.  L. f  Hon,  R.  H. ,  and  Smyth,  R.  K.  Preliminary  candidate  advanced 
avionics  systezn  (PCAAS)  -  reduction  in  single  pilot  workload  during 
instrument  flight  rules  flight.  Hawthorne,  California:  Systems  Technology, 

•w  mr  i  no  '  1  ua  i  /rr»  i  r  rtAO  r  \  n  jl. ,1_ 1  An** 

inc.  iR-Jl'JOH-JL  ,  oe|ltelD«t  ,  i-f/i. 

Specifications  which  define  the  system  functional  requirements,  the  subsystem 
and  interface  needs,  and  other  requirements  such  as  maintainability,  modularity, 
and  reliability  are  summarized.  A  design  definition  of  all  required  avionics 
functions  and  a  system  risk  analysis  are  presented. 

W/L  Cat.  Code:  2.1.1,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 


Spare  m.  capacity  Task  comp.,  Construct  Laboratory 

time  assess. 

Primary  task  Math,  model  Experimental  Flight  simulator 


Flight  simulator 


SY-27R-80 


Tar Break,  F.  High  workload  taaka  of  alrcraw  ’n  th«  tactical  strike,  attack, 
and  reconnaissance  roles.  In  aUARD  simulation  and  atudy  of  high  workload 
operations .  AGARD- CP-146,  October,  1974,  A17-1  -  17-3. 

High  workload  tasks  are  outlined  for  aircrew  performing  three  distinct 
tactical  roles,  nan*3y  the  strike,  the  attack  and  the  reconnaissancu  roles. 
Th*  total  mission  is  covered,  which  is  from  the  time  the  pilot  receives 
his  orders  until  the  debriefing  following  the  flight  has  been  completed. 

At  the  same  time  differences  between  each  role,  as  related  to  workload, 
are  printed  out  so  that  a  fairly  realistic  comparison  can  be  made  as  to 
the  workload  of  each  category. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.1,  1.2,  2.1,  4.2 


Spare  m.  capacity  Task  comp..  Construct  None 

time  assess. 


Flight  simulator 
Flight  rest 


Thackray,  R.  I.,  Jones,  K.  N. ,  and  Touchstone,  R.  M.  The  color-word  interference 
test  and  its  relation  to  performance  itjpai ro^nt  under  auditory  distraction. 
Oklahoma  City,  Oklahoma:  Civil  Aeromcdical  Institute,  FAA-AM-72-14, 

March,  1973. 

An  examination  was  made  of  the  relationship  between  performance  on  the  Stroc 
color-word  interference  test  (a  suggested  measure  of  distraction  susceptibility) 
and  impairment  under  auditory  distraction  on  a  task  requiring  the  subject  to 
generate  random  sequences  of  letters.  Although  there  was  a  significant  decrease 
in  randomness  as  a  result  of  auditory  distraction,  the  correlation  between  change 
in  randomness  and  amount  of  color-word  interference  was  nonsignificant.  These 
findings  suggest  that  the  Stroop  test  may  measure  a  rather  restricted  type  of 
perceptual  interference  essentially  unrelated  to  a  possibly  more  general  ability 
to  maintain  concentration  in  the  presence  of  competing  (distracting)  stimuli. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  3. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 

Primary  task  Single  measures 
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Thorns,  R,  G.  Pilot  workload:  A  coocapfu#.’  modal.  AGARi)  Confaranca  Proceedings 
Ho.  119  on  a*, ability  sr  •<  Control,  Brsv.  <r  chwelg,  Germany,  April  10-13,  1972, 
21-1-21-6.  Z .GART-CP-J  1^V.  t>l>  754  524). 

A  conceptual  nodal  la  dcacrlbad  fo-  the  situation  when,  some  of  the  crew,  some 
of  the  tlaa,  are  unable  to  complete  satisfactorily, some  of  their  tasks.  The 
model  relates  task  difficulty  to  operator  capacity  as  a  means  of  defining 
areas  of  overload.  A  case  is  made  for  more  realistic  simulations  of  the 
more  difficult  tanks. 

W/L  Cat.  Code:  2.1.1,  2.1.2 

op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Math,  model  Construct  None  Background 


Tomashevskaya,  L.  1.  The  reaction  of  the  rardio-vascuiar  and  sympathico- 

adxenal  systems  to  intellectual  activity  with  emotional  stress-human  operator 
performance.  Och&rki  Psykhologli  Truda  Opera tor a.  Moscow:  NauRa  Press, 

1974,  275-290.  (In  Russian.)  (English  translation  appears  in  Essays  on  the 
Psychology  of  Operator  Lrbor.  NASA-TT-F-16020,  January,  1975,  335-351.) 

The  iffec:  of  emotioganic  factors  on  an  operator's  intellectual  activity  were 
studied  for  dlf  faring  working  regimes  on  ar  experiments!  control  pane!  that 
provided  for  light,  sonic,  and  electrocutancoiu-  stimuli.  The  latter  stimulus  wan 
activated  automatically  if  the  subject  gave  an  incorrect  response.  It  was 
shown  that  the  working  caprcitv  of  the  operator  under  stress  depends  to  a  great 
extent  on  the  effect  ot  tha  emotiogenic  factor  on  the  individual  functioning 
characteristics  if  the  cardiovascular  and  syapathetic-oc'raoal  systems.  Moral, 
intellectual,  willpower,  emotional,  and  other  personality  traits  are  decisive 
factors  of  operator  function. 


W/L  Ca Code: 
Op.  Behav.  Code: 
Primary  task 
Physiological 


3.1,  4.1.10,  4.1.12 


Single  "ensures  Experimental  Laboratory 

Heart  rate, 
h.r.  var. 

Body  fluid 
anal. 


Background 
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Trigg*,  T.J.  Asp* eta  of  mental  workload.  ?roce*dlnga  of  tha  I3KE-GKKS  KRS 
International  Symposium  on  Man-Machlns  Systems,  Cambridge,  England, 

Sap tanker,  1969. 

During  task  performance,  the  nacura  of  the  information  processing  demand*  at 
any  point  in  time  obviously  determines  to  a  large  extent  the  operator's  mental 
workload.  However,  the  human  in  operational  circumstances  must  be  regarded  a* 
more  than  a  passive  single-channel  processor  of  information.  In  situations  of 
any  complexity,  there  may  be  time-sharing  demands  on  the  human,  or  he  may  be 
required  to  respond  to  a  rapid  sequence  of  signals.  There  le  good  evidence  in 
such  situations  that  tha  nature  rf  tha  task  which  the  operator  may  be  called  on 
to  perform  at  short  notice  can  influence  the  current  work load  and  degrade  present 
performance.  These  aspects  cf  task  loading  will  be  considered  In  tarma  of  a 
central  capacity- sharing  model,  where  the  preparatory  processes  required  for 
task  elements  immediately  in  tha  future  are  assumed  to  require  Information- 
processing  capac  Ity.  Experimental  data  from  a  serial  reaction-time  task  will 
be  presented  in  support  of  the  model.  The  results  indicate  that  the  preparatory 
state  for  a  future  reaction  can  be  developing  prior  to  emission  of  the  preceding 
response,  and  that  processing  capacity  is  allocated  between  the  components  of 
the  serial  task  to  allow  this  active  process  of  prepsraticn. 

W/L  Cat.  Code:  2.2.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 


Trumbo,,  D.  and  Noble,  M.  Response  uncertainty  in  dual-task  performance. 
Organizational  Behavior  and  Human  Performance,  1972,  7_,  203-215. 

In  three  experiments,  Ss  performed  under  one  of  several  secondary  task 
conditions  while  engaged  in  pursuit  tracking  ns  a  primary  task. 

Secondary  tasks  were  of  the  information  creation  (l'tnany)  type  with 
from  one  to  five  alternative  response  buttons  to  be  used  randomly  in 
response  to  a  tone  cue.  The  results  generally  support  the  prediction 
that  Interference  in  the  primary  task  increases  as  a  function  of  the 
response  uncertainty  in  the  necondary  task.  These  results  provide 
farther  evidence  that  information  processing  capacity  may  be  relatively 
limited  at  the  response  selection  stage. 

k/L  Cat,  Code:  2.2-1,  2.2.2 

Op.  Behav.  Code:  1.,  2.,  4. 

ispare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Background 
Primary  task  Single  measures 
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Trumbo ,  ,  Noble,  M.  and  Swiuk,  J.  Secondary  tack  irtr.rf  ererca  in  the 

pet f.  aance  of  tracking  taeka.  Journal  of  layer lmental  Psychology.  1967, 
73.  232-240. 

The  effects  of  aecondary  verbal  tasks  on  tracking  performance  ware  examined. 

In  Experiment  I,  redundancy  was  varied  in  both  primary  and  secondary 
tanka,  with  the  latter  introduced  at  a  retention  session.  The  secondary  task 
resulted  in  marked  interference,  independent  of  either  primary  to  secondary 
task  redundancy,  primarily  in  the  timing  aspect  of  tracking.  In  Experiment 
II,  stimulus  and  response  components  of  the  secondary  task  were  presented 
separately.  The  responsa  component  produced  as  much  interference  ao  the 
cognitively  more  difficult  secondary  task.  Experiment  III  shewed: that 
secondary  task  effects  occur  Independent  of  a  racentlon  interval. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Ursln,  U.  and  Urain,  R.  Physiological  indicators  of  mental  load.  In  N.  Moray 
(Ed.)  Mental  workload:  its  theory  and  measurement.  New  York:  Plenum  Press, 
1979,  349-365. 


This  paper  discusses  the  available  methods  of  measuring  mental  load  by  physiological 
methods.  Specifically,  five  physiological  aspects  are  reviewed:  activity  of  the 
central  nervous  system;  specific  activation;  energy  requirements;  wear  and  tear, 
streps,  strain,  and  health;  and  restoration  processes.  Tne  position  taken  is 
that  it  is  fairly  easy  to  measure  and  therefore  exclude  the  physical  workload, 
and  measure  psychological  activation.  However,  there  are  serious  difficulties 
if  one  desires  to  dlocriminate  between  emotional  factors  and  information  workload. 

If  this  is  not  done,  measuring  "mental  workload"  does  not  involve  anything  but 
conventional,  evaluation  of  "activation'',  on  which  there  is  a  considerable  bulk 
of  information. 

W/L  Cat.  Code:  4. 


Op.  Behav.  Code: 

1.,  2.,  3.,  4. 

Physiological 

Mv?  tiple 

Review 

None 

Flight  simulator 


Construct 
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van  Gigch,  J.P.  A  nodal  for  aaaauring  tha  information  procaaaing  ratas  and 
Mntal  load  of  complex  activltloa.  Canadian  Opa rational  Research  Sociaty 
Journal.  1970,  8,  116-?. 28. 

Whan  industrial  operatives  par fora  complex  activities  during  their  work  tha 
corraapondanca  between  stiauli  and  responses  becomes  difficult  to  astablslh.  In 
auch  caeca,  existing  models  which  require  that  the  aarginal  probabilities  of 
inputs  and  outputs  be  known  cannot  be  used  to  aaasura  tha  amount  of  information 
transmitted.  A  modal  is  presented  hare  which  allows  quantification  of  tha  levels 
of  integrative  behavior  on  tha  basis  of  the  determination  of  the  total  entropy 
transmitted  in  tha  performance  of  information  processes  of  various  degrees  of 
complexity.  Mantel  tharbligs  aru  used  to  describe  tha  activities  of  the  human 
communication  channel .  This  leads  to  tha  calculation  of  tha  total  amount  of 
information  transmitted  from  input  stimuli  to  output  responses,  and  to  tha 
detarmlnatl  n  of  an  information  processing  rate  which  characterizes  the  mental 
content  of  tha  work  performed. 

tf/L  Cat.  Code:  2.1.2 

Op  Bahav.  Code:  2.1 

Spare  m.  capacity  Inform,  theory  Construct  Field  Flight  test 


van  Gigch,  J.P.  Applications  of  a  model  used  in  calculating  the  mental  load 
of  workers  in  industry.  Canadian  Operational  Research  Sociaty  Journal, 

1970,  8,  176-184. 

This  paper  describes  the  field  work  and  results  obtained  in  the  application  of 
a  modal  of  integrative  behavior  which  is  used  to  measure  the  mental  load  of 
various  Industrial  tasks.  The  modal  identifies  information  processes  which  take 
place  while  r.h«t  operator  is  performing  his  work.  The  amount  of  information,  in 
the  Information  theory  sense,  which  is  transmitted  while  the  human  communication 
system  accomplishes  mental  tharbligs  is  calculated.  The  application  of  this  modal 
is  made  to  seta  of  jobs  found  at  two  or  more  distinct  levels  of  technology.  Tha 
mental  contribution  of  induatrial  workers  is  analyzed  to  determine  the  Impact 
of  technology  on  the  mental  content  of  work.  The  information  processing  rates 
are  broken  into  their  two  components — entropy  per  cycle  and  repetition  cycle  rate — 
to  evaluate  the  potential  for  further  mechanization  and  automation.  The  effects 
of  increasing  work  complexity  on  the  operators'  speeds  of  response  are  studied. 

W/L  Cat.  Code:  2.1.2 

Op.  Behav.  Code:  2.1 

Spare  m.  capacity  Inform,  theory  Construct  Field  Flight  simulator 

Flight  test 
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Ver plank,  V.  L.  Is  there  an  optimum  work- load  In  manual  control?  Proceedings 
of  ha  12th  Annual  KASA-Unlvarslty  Conference  on  Manual  Control.  University 
of  Illinois,  May,  1976,  72-79.  (NASA  YM  X-73,  l)0) . 

Experiments  on  a  clcsed-circult-televlsion  driving  simulator  were  designed 
to  answer  the  question:  is  there  an  optimum  t ork- load  that  (a)  sustains 
performance  m  long-term  driving  and  (b)  facilitates  transitions  to  new 
tasks  or  emergencies?  The  results  affirm  (a)  with  r nervations  but  not  (b). 

A  second  experiment  is  planned  and  a  new  measure  for  work-load  proposed. 

W/L  Cat.  Code:  3.1 

Op.  Behev.  Code:  1.,  2.,  4.2 

Primary  task  Single  measures  Experimental  Simulator  Background 


Verplank,  W.  L.  The  facilitating  effects  of  uncertainty  in  long-term 
manual  control.  Proceedings  of  the  13th  Annual  Conference  on  Manual 
Control,  Massachusetts  Institute  of  Technology,  1977,  101-117. 


A  tracking  taat  with  different  disturbance  inputs  was  used  to  look  for  the  effects 
of  reduced  task  demands  on  long  term  manual  control.  The  expected  facilitating 
effects  of  task  difficulty  are  hak-i  to  find.  The  decrements  in  performance  over 
the  run  are  no  greater  for  the  easier  tasks.  The  detrimental  effects  of  lower 
demand  appear  to  be  increase!  relative  variability  in  peiformance,  and  possibly 
reduced  performance?  on  transition  tc  unexpected,  more  difficult  tasks.  An 
information  measure,  including  the  ^  *'ects  of  'self-induced*  uncertainty  is 
developed  as  a  work- load  measure.  There  Is  a  positive  correlation  between  this 
'self-induced  workload’  rad  performance  decrement  for  the  easiest  task,  just  the 
opposite  of  what  the  facilitation  hypothesis  would  predict. 


W/L  Cat.  Codes  2.1.2,  3.3 

Op.  Behav.  Code:  1.,  2.,  4. 


Spare  m.  capacity  Inform,  theory  Construct  Laboratory  Flight  simulator 

Primary  task  Math,  model  Experimental 


SY-27R-S0 


Vettcs,  B.  Evaluating  the  workload  of  helicopter  pilots.  In-flight  recording) 
of  heart  rate  and  cardiac  arrhythmia.  In  AGARD  Studies  on  Pilot  Workload, 
A‘JARD-C?-217,  November,  1977,  (In  French.) 

In-flight  recordings  were  made  of  the  heart  rate  and  cardiac  arrhythmia  in  four 
helicopter  test  pilots  during  increasingly  difficult  ILS  approaches.  Five  types 
of  tasks  were  identified,  each  task  being  repealed  five  times  during  the  same 
flight.  An  analyses  of  concommitant  rhythm  variations,  especially  if  the  subject 
had  a  greater  number  of  variations  when  at  rest.  This  increase  of  cardiac  rhythm 
is  exacerbated  by  the  addition  of  external  function  factors  (turbulence).  The 
influence  of  apprehension  is  evidenced  by  a  detectable  decrease  in  heart  rate 
during  successive  repetitions  of  the  same  task.  The  inclusion  of  subjective 
criteria  can  provide  some  useful  information.  A  study  of  arrhythmia  appears  to 
be  a  better  measure  than  the  instantaneous  heart  rate;  however ,  an  exact 
relationship  between  these  parameters  and  the  aviator's  workload  can  not  yet  be 


affirmed. 

W/L  Cat.  Code: 

1.2,  4.1.10 

Op.  Behav.  Code: 

1.,  2.,  4. 

Opinion 

Questionnaire 

Experimental  Flight  test  Flight  simulator 

Physiological 

Heart  rate, 
h . r .  var . 

Flight  test 

Voile,  M.  A.  Work,  fatigue,  and  frequency  of  critical  flicker  fusio-u. 

Ergonomics,  1978,  21,  551-558.  (In  French.) 

Fatigue  due  to  a  physical  or  a  mental  workload  is  here  considered  as  a  dynamic 
phenomenon  dependent  upon  the  type  of  work  performed.  Acute  or  chronic  fatigue, 
as  measured  by  CFF,  has  often  led  to  contradictory  interpretations  among  research 
workers.  Data  presented  come  from  five  groups  of  subjects  submitted  to  different 
mental  or  physical  workloads  and  to  CFF  measurements  before,  during  and  after  the 
task.  In  general,  with  initiation  of  work,  an  increase  in  CFF  is  observed  which 
probably  corresponds  to  a  CNS  excitation  induced  by  the  workload.  However,  it 
appears  that  only  some  definite  work  situations  could  induce  a  CFF  decrease  as 
it  is  generally  accepted  for  chronic  or  acute  fatigue.  In  some  tasks,  the  CFF 
continued  to  increase  after  work;  in  others,  it  showed  no  variation  or  decreased 
below  the  basal  level  observed  at  rest. 

W/L  Cat.  Code:  4.1.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Physiological  FPF  Experimental  Laboratory  Background 
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Waller,  H*  C.  An  Investigation  of  correlation  bst’ven  pilot  scanning  behavior 
and  workload  using  stepwise  regression  analysis.  Haupton,  Virginia;  NASA 
Langley  Research  Center,  NASA  TM  X-3344,  March,  1976. 

An  electro-optical  device  called  an  oculometer  which  tracks  a  subject’s  look- 
point  as  a  tine  function  has  been  used  to  collect  data  in  a  real-tine  simulation 
study  of  Instrument  landing  system  (1LS)  approaches.  The  data  describing  the 
scanning  behavior  of  a  pilot  during  the  instrument  approaches  have  been  analysed 
by  use  of  a  stepwise  regression  analysis  technique.  A  statistically  significant 
correlation  between  pilot  workload,  es  Indicated  by  pilot  ratings,  and  scanning 
behavior  has  been  established.  In  addition,  it  was  demonstrated  that  parameters 
derived  from  the  scanning  behavior  data  can  be  combined  in  a  mathematical  equation 
to  provide  a  good  representation  of  pilot  workload. 

W/L  Cat.  Code:  1.1,  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 

Opinion  Rating  scale  Experimental  Flight  simulator  Flight  simulator 

Physiological  Eye  movement  Flight  test 


Waller,  M.  C.,  Harris,  R.  I...  Sr.,  and  Salrairs,  S.  A  study  of  parameters 
affecting  a  display  for  aircraft  instrument  landing.  Proceedings  of  the 
23rd  Annual  MeetinR  of  the  Human  Factors  Society,  Boston,  Massachusetts, 
October  29-November  1,  1979,  345-346. 


This  paper  presents  tha  results  of  a  series  of  tests  conducted  in  a  fixed  base 
simulator  to  evaluate  the  effects  of  varying  parameters  of  a  vertical  situation 
display  for  landing  a  transport  aircraft.  The  results  of  the  test  were  evaluated 
in  terme  of  touchdown  performance,  pilot  control  activity,  and  scanning  behavior. 
The  results  indicate  that  size  of  the  display,  location  of  the  display,  and  amount 
of  information  provided,  all  play  a  role  in  touchdown  performance.  It  is  also 
concluded  that  the  presence  of  a  perspective  runway  improves  pilot  acceptance 
of  the  display  for  landing. 

W/L  Cat.  Code:  3.1,  4.1.7 


Op.  Behav,  Code: 
Primary  task 
Physiological 


1. ,  2. ,  4. 

Single  measures  Experimental  Laboratory 
Eye  movements 


Flight  simulator 


309 


SY-27  R-80 


Wanner,  J.  C.  The  mr.ltiloop  concept  of  pilot  workload  as  a  basin  of  future 
experiments  and  studies.  Chatillon-soua-Bagneux,  Hauta-de-Seine ,  France: 
OWERA,  TP  No.  1978-10,  1978.  (In  French.) 


The  perceptual  and  behavioral  components  of  a  pilot's  performance  are  examined, 
a  multiloop  mathematical  model  of  pilot  behavior  is  presented,  an  approach  to 
analysing  flight  conditions  and  pilot  tasks  Is  Indicated,  and  differences  in 
feedback  and  loop  characteristics  for  servomechanisms  and  for  human  pilots  are 
noted.  A  multiloop  workload  is  more  than  the  sum  of  the  component  loops  (involving 
control  of  or  response  to  e  single  parameter  or  variable)  alnce  the  multiloop 
workload  includes  the  switching  task,  which  is  the  transition  from  one  loop  to 
mother.  Short-term  safety  loops,  immediate  safety  loops,  and  control  forces 
are  distinguished,  and  accidents  are  analysed  with  relation  to  the  workload. 

W/L  Cat.  Code:  3.1 


Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


1.,  2.,  A. 

Subsidiary  task  Construct 
Single  measures 


None 


Background 


Watson,  B.  L.  The  effect  of  secondary  tasks  on  pilot  describing  functions 
in  a  compensatory  tracking  task.  Toronto,  Canada:  University  of  Toronto, 
Institute  for  Aerospace  Studies,  UTIAS  Technical  Note  No.  178,  June,  1972. 

This  report  explores  the  effect  certain  secondcry  tasks  have  on  human  pilot 
describing  functions.  The  describing  functions  were  generated  from  a 
compensatory  tracking  task  with  rate-control  dynamics.  The  experiment 
involved  six  well-trained  subjects  in  a  multi-task  situation  urhere  the 
primary  control  task  was  tracking.  The  results  are  presented  ac  amplitude 
and  phase  plots  of  measured  describing  functions,  which  are  fitted  by  an 
eight-parameter  theoretical  pilot  model.  The  effects  are  described  in  terms 
of  both  raw  data  and  model  parameters. 

W/L  Cat.  Code:  2.2.1,  3.3 

Op.  Behav.  Coda:  1. ,  2. ,  A. 

Spare  m.  capacity  Subsidiary  task  Experimental  laboratory  Flight  simulator 
Primary  task  Math,  model  Flight  ceet 


SY-Z7R-80 


Waugh,  J.  D.  Pilot  performance  In  helicopter  simulator.  Aberdeen  Proving 
Ground,  Maryland.'  d.S.  Army  Engineering  Laboratory,  Technical  Memorandum 
23-75,  September,  1975.  (AD  A017  441). 

Six  Army  helicopter  pilots.  Instrument  reted,  flew  a  difficult  precision 
Instrument  flight  pattern  in  this  laboratory's  GAT-2H  helicopter  simulator. 

For  each  flight,  each  subject  was  given  a  different  combination  of  thrust  to 
weight,  cyclic  control  sensitivity  and  cyclic  spring  centering  force  gradient 
condition  making  up  an  incomplete,  balanced  block-type  experimental  design. 
Several  error  measurements  were  recorded  during  the  trials;  however,  none 
could  be  satisfactorily  utilized  to  predict  either  accuracy  cf  performance, 
or  be  an  indicator  of  relative  workload.  An  unanticipated  large  variation  of 
measures  taken  is  thought  to  be  the  cause.  Additional  approaches  and  further 
study  of  the  problem  is  recommended. 

W/L  Cat.  Code:  3.2 

Op.  Behav.  Code:  1.,  2.,  4. 

Primary  task  Mult,  measures  Experiments?  Flight  simulator  Flight  simulator 

Flight  teat 


Way,  T.  C.  Verification  of  worklo&d-a  job  for  simulation-pilot  performance. 

In  Flight  Technologies  Conference.  Arlington,  Texas,  September,  1978,  99-104. 
(American  Institute  of  Aeronautics  and  Astronautics,  New  York.) 


The  challenge  tc  designers  cf  flight  deck?  and  avionics  suites,  is  to  configure 
the  crew  station  in  such  a  way  that  required  tasks  can  be  accomplished  by  the 
allotted  crew  complement  while  holding  crew  workload  within  reasonable  limits. 
An  outline  is  presented  of  an  approach  involving  the  use  of  piloted  simulation 
as  an  aid  in  meeting  this  challenge.  The  advantages  of  simulation  over  flight 
test  for  workload  studies  include  cost,  safety,  efficiency,  and  timeliness.  It 
is  found  that  the  state'-of-the-art  in  fine-grain  workload  assessment  is  not 
particularly  satisfying.  However,  it  is  possible  to  take  the  broader  approach 
of  designing  end  integrating  a  flight  deck  to  mirlmize  workload  based  on  prior 
experience,  industry  standards,  and  good  human  tr^ineering  practice. 

W/L  Cat.  Code: 

Op.  Behav.  Code: 

Spare  m.  capacity 

Primary  task 


2.1,  3.3 
1. ,  2. ,  3.,  u. 

Task  analytic  Construct  None  Background 

Math,  model 


J 
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Hair,  D.  H.  and  Klein,  R.  H.  Measurement  and  analysis  of  pilot  scanning  behavior 
during  simulated  Instrument  approaches.  Proceedings  of  the  6th  Annual  NASA- 
Univarsicy  Conference  on  Manual  Control.  Wricht-Patterson  APB,  April,  1970. 
63-108.  '  “ 

Experimental  measurements  of  pilot  scanning  and  control  response  in  a  simulated 
instrument  approach  are  reported.  Airline  pilot  subjects  flew  ILS  approaches 
in  a  six  decree  of  freedom  fixed-base  DC-8  Simulator  at  the  NASA  Ames  Research 
Center.  A  conventional  instrument  panel  and  controls  were  used,  with  simulated 
vertical  gust,  and  glide  slope  beam  bend  forcing  functions.  Pilot  eye  fixations 
and  seen  traffic  on  the  panel  were  measured  using  a  recently  developed  eye-point- 
cf -regard  system.  Simultaneous  recordings  were  made  of  displayed  signals,  pilot 
response,  and  vehicle  .motions.  The  date  were  reduced  for  31  approaches  with  a 
cross  section  of  subjects  to  obtain  dwell  times,  look  rates,  scan  rates,  and 
fractional  scanning  workload.  Flight  director  approaches  as  well  an  standard 
localiaer/gllde  slope  approaches  vers  made.  The  scanning  results  showed  the 
attitude  and  glide  slope/ localizer  instruments  to  be  primary  in  a  manual  ILS 
approach.  Differences  in  dwell  time  between  pilots  occurred  mainly  on  the  attitude 
instrument.  With  the  flight  director,  glide  path  deviation  errors  were  reduced 
and  the  flight  director  instrument  dominated  pilot  attention.  There  were  no 
apparent  circulatory  scanning  patterns  in  any  of  the  appor aches. 

W/L  Cat.  Code:  4.1.7 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Eye  movement  Experimental  Flight,  simulator  Flight  simulator 

Flight  test 


We If or d,  A.  T.  Stress  and  performance-behavioral  and  ergonomics  aspects. 

Ergonomics ,  1973,  16,  567-530. 

The  affects  on  performance  are  discussed  of  various  types  of  stress  deriving  from 
imbalance  between  capacity  on  the  one  hand  and,  on  the  other,  the  demands  of  tasks, 
environmental  conditions  and  social  situations  which  either  overload  or  underload 
the  individual.  Common  cybernetic  principles  seem  to  apply  over  an  areu  which 
includes  not  only  stress,  but  also  motivation  and  arousal.  A  model  is  proposed 
which  ties  together  three  previously  existing  inodels  current  in  this  field:  The 
Inverted-U  Hypothesis,  Signal  Detection  Theory  and  the  Yerkea-Dodson  Law.  The 
model  is  examined  further  in  relation  to  individual  differences. 

W/L  Cat.  Coda :  2.1.1,  3.1 

Op.  Bcshav.  Code:  1.,  ?. 

Spare  m.  capacity  Task  comp..  Construct  None  Background 

time  assess. 

Primary  task  Math,  model 
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Walford,  A.  T.  Mental  work-load  as  a  function  of  demand,  capacity,  strategy 
and  aklll.  Ergonomics ,  1978,  21,  151-167. 

An  attempt  is  maoe  to  outline  a  conceptual  framework  in  which  to  view  the 
problema  of  defining  and  measuring  mental  work- load.  This  is  treated  in  terms 
of  the  demands  made  by  tasks,  the  capacities  the  subject  brings  to  meet  those 
demands,  and  the  strategies  he  usee  to  relate  the  first  to  the  second.  Two  types 
of  demand  are  distinguished:  the  amount  of  data  tc  be  handled  at  a  particular 
moment,  and  the  amount  to  be  dealt  with  during  a  particular  period  of  time  Each 
type  io  considered  in  relation  to  the  main  central  functions  of  perception,  decision 
and  choice,  phasing  and  coordination  of  action,  memory,  and  motivation.  Capacity, 
and  the  effects  of  various  factors  upon  it,  are  considered  in  relation  to  concepts 
of  signal- to-noise  ratio  in  the  central  nervous  system.  Two  basic  approaches  to 
the  measurement  of  work- load  are  compared:  the  synthetic,  in  which  the  load 
imposed  by  the  task  as  a  whale  is  calculated  from  the  loads  Imposed  by  its 
components;  and  the  analytic,  in  which  the  task  is  studied  as  a  whole,  and 
components  are  analyzed  from  the  whole  performance. 


U/L  Cat.  Code: 

2.11,  3.1 

Op.  Behav.  Code: 

1.,  2.,  4. 

Spare  m.  capacity 

Task  comp..  Const ruct 

None 

Flight  simulator 

time  assess. 

Primary  task 

Single  measures 

Flight  test 

Wempe,  T.  E.  and  Baty,  D.  L.  Human  Information  processing:  rates  during  certain 
multiaxis  tracking  tasks  with  a  concurrent  auditory  task.  IEEE  Transactions 
on  Man-Machine  Systems,  1968,  MMS-9 ,  129-138. 

A  series  of  experimen.3  was  conducted  to  determine  the  information  processing 
rates  of  several  subjects  performing  one-  and  two-axis  compensatory  tracking 
tasks  with  a  secondary  auditory  task.  The  experimental  variables  were  the 
order  of  controlled  element  dynamics,  the  forcing  function,  and  the  addition 
of  a  secondary  task.  Human  information  processing  rates  decreased  slightly 
on  each  tracking  channel  with  the  addition  of  the  second  tracking  channel  or 
the  secondary  auditory  task.  Other  than  this  effect,  the  Information  processing 
rates  were  additive  until  a  limit  in  the  total  information  processing  rate  was 
reached.  This  limit  was  related  to  the  order  of  the  controlled  element. 


W/L  Cat.  Code:  2.1.2,  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Inform,  theory  Experimental  Laboratory  Flight  simulator 
Primary  task  Subsidiary  task  Flight  test 

Single  measures 
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Heut brook,  C.  B. ,  Andurson,  R.  0.  and  Piatreak.,  T>.  E.  Handling  qualities  and 
pilot  workload.  Wright-Pat teison  kf  \ ,  Ohio:  AP  Plight  Dynamics  Laboratory, 
AFFDL-FDCC-TM-6 6-5 ,  September,  1966.  (AD  655  340). 

This  paper  has  the  objective  of  defining  the  relationship  between  handling 
qualities  and  pilot  stress  and  workload.  The  reasons  underlying  the  Importance 
of  pilot  workload  measurement  are  discussed  and  ways  to  analyse  or  treat  pilot 
vehicle  systems  are  reviewed.  The  various  measures  of  pilot  workload  that  have 
been  used  or  considered  are  discussed  and  some  new  data  on  the  possible  use  of 
pupil  dilation  as  a  measure  of  stress  are  presented. 

W/L  Cat.  Code:  2.2.5.  3.3,  4.1.2,  4.1.4,  4.1.8 

Op.  Behav.  Code:  l.,2.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  Laboratory  Flight  simulator 

Primary  task  Math,  model  Experimental  Flight  test 

Physiological  Pupilary  dia. 


Weverinke,  P.  H.  Human  control  and  monitoring-models  and  experiments. 
Proceedings  of  the  12th  Annual  HASA-University  C inference  on  Manual 
Control,  University  of  Illinois,  May,  1976,  14-28.  (NASA  TMX-73,  170). 

This  paper  deals  with  the  results  of  a  theoretical  and  experimental  program 
concerning  human  monitoring  behavior.  Apart  from  monitoring  sr.  automatic 
approach,  combined  monitoring  and  manual  flight  director  control  was  studied 
to  determine  the  interference  between  subtasks.  Also  simultaneous  monitoring 
and  auditory  trucking  was  included.  The  results  demonstrate  that  the  multi- 
variable  monitor  model  adequately  describes  human  behavior  in  the  aforementioned 
tasks.  Furthermore,  a  multivariable  workload  model  is  developed.  Computed 
workload  Is  shown  to  agree  excellently  with  subjective  ratings. 

W/L  Cat.  Code:  1.1,  2.2.1,  2.2.2,  3.3 

Op.  Behav.  Code:  1. ,  2. ,  3. ,  4. 

Opinion  Rating  scale  Construct  Laboratory  Flight  simulator 

Spare  m.  capacity  Subsidiary  task  Experimental  Flight  test 

Primary  task  Math,  model 
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Weverinke ,  P.  H.  Performance  and  workload  analysis  of  in-flight  helicopter 

<ska.  Proceedings  of  the  13th  Annual  MASA-Pniversity  Conference  on  HanuaJ 
Control ,  Massachusetts  Institute  of  Technology ,  June  15-17,  1977,  IOiS-117. 

The  study  described  in  this  paper  vas  aimed  at  assessing  the  potentials  of 
the  optimal  control  model  structure  to  predict  the*  important  characteristics 
of  realistic  operational  helicopter  missions.  The  theoretical  and  experimental 
resdlts  indicate  that  the  optimal  control  model  successfully  predicts  the  best 
attainable  (rather  than  the  average)  Inflight  performance  of  a  group  of  well- 
trained,  highly  motivated  subjects.  Furthermore,  the  model  allows  a  description 
of  inter-subject  variability.  The  control  effort  model  predictions  have  been 
supported  by  subjective  ratings.  The  model  seems  to  provide  a  meaningful 
representation  of  pilot  workload  Involved  in  complex  control  tasks. 


W/L  Cat.  Code: 

1.1,  3.3 

Or.  Behav.  Code:  l.t  2.,  4. 

Opl.-  jn 

Rating  scale 

Experimental 

Flight  test 

Flight  simulator 

Primary  task 

Math,  model 

Flight  test 

Wewerinke,  *.  H.  and  Smlt,  J.  A  simulator  study  to  investigate  human  operator 
wo rkload .  Proceedings  of  the  AGARD  Conference  on  Simu Vat ion  and  Study  of 
High  ’  rkload  Operations,  AGARD-CP-146 ,  April,  1974,  A2-1  -  A2-6. 

This  pap  presents  the  results  of  an  exploratory  experiment  which  was  conducted 
to  invee  ate  human  response  characteristics  in  control  situations  of  widely 
varying  difficulty.  The  experiment  was  aimed  at  a  better  understanding  of  the 
human  operator  limitations  in  terms  of  control  effort  as  included  in  the  optimal 
control  mode  ,  Based  on  the  experimental  results  a  control  effort  index  is 
presented.  ne  "predicted"  control  effort  correlates  well  with  subjective 
ratings  an'1  eems  to  possess  generality. 

W/L  Cat.  Code:  1.1,  3.3 

Op.  Behav.  Code:  4.2 

Opinion  Rating  scale  Construct  Flight  simulator  Flight  simulator 

Primary  task  Math,  model  Experimental  Flight  test 
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Whitaker,  L.  A.,  Dual-task  interference  aa  a  function  of  cognitive  xoad 
processing.  Acta  Psychologies.  1979,  .43,  71-84. 

Sixteen  subjects  participated  in  a  dual-task  study  designed  to  measure  processing 
requirements  of  a  choice  reaction  time  (RT)  task.  Two  levels  of  choice  RT  stimulus- 
response  (S-R)  compatibility  were  tested  with  each  of  two  tracking  tasks  to  provide 
different  levels  of  dual-task  loading.  In  one  tracking  task,  the  target’s  temporal- 
spatial  pattern  was  fixed;  in  the  other,  the  target's  path  was  e  function  of  the 
subject's  performance.  Choice  RT  results  indicated  that  compatibility  and  set 
size  Interacted;  the  Increase  in  response  latency  as  a  function  of  sat  size  was 
much  greater  when  compatibility  was  low.  An  increase  in  choice  RT  response 
latency  occurred  when  the  secondary  tracking  task  was  added.  Within  a  given 
compatibility  level,  this  dual-task  decrement  was  constant  for  all  levels  of  set 
size;  however,  the  magnitude  of  dual-task  decrement  varied  as  a  junction  of  S-R 
compatibility,  being  greater  when  compatibility  was  low  than  when  it  was  high. 


W/L  Cat.  Code: 

2.2.,  2.2.5,  3.1 

Op.  Behav.  Code: 

1. ,  2. ,  3. ,  4. 

Spare  ui.  capacity 

Subsidiary  task  Experimental 

Primary  task 

Single  measures 

Laboratory 


Flight  ainulator 


White,  R.  T.  Task  analysis  methods:  Review  and  development  of  techniques  for 
analyzing  mental  workload  in  multiple-task  situations.  St.  Louis,  Missouri: 
McDonnell  Douglas  Corporation.  MDC  J  5291.  September.  1971. 

Representative  task  analysis  formats  were  reviewed  and  a  large  number  of  task 
classification  schemes  or  taxonomies  were  analyzed.  The  historical  develonment 
of  these  techniques  was  reviewed  to  Identify  weaknesses  and  sources  of  er*or. 
Various  attempts  to  quantify  workload  also  were  reviewed  and  the  desirable 
characteristics  of  an  improved  approach  to  task  analysis  were  identified.  With 
this  as  background,  an  approach  to  task  analysis  was  developed  that  concentrates 
on  the  interactions  between  tasks  and  the  time-sharing  or  scheduling  demands 
that  are  imposed  on  operators.  Cognitive  or  mental  workload  is  stressed  rather 
than  sensory  or  motor  aspects  of  tasks.  This  approach  analyzes  broad  operator 
functions  or  tasks  in  relation  to  the  task  characteristics  or  demands  that 
determine  workload  and  is  suitable  for  use  during  early  design  phases  when 
detailed  task  Information  is  not  available.  An  example  is  given  to  illustrate 
its  use  in  analyzing  a  complex,  multlpia-task  situation.. 

W/L  Cec.  Code:  2.1.1,  2.1.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spars  m.  capacity  Task  comp..  Review  None  Flight  simulator 

time  assess. 

Inform,  theory  Flight,  test 
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White,  R.  T.  Mental  workload  aaaaaanant,  I.  Laboratory  lnvaatigation  ox 
decision-making  and  ihort-t^ra  memory  in  a  multiple-task  situation . 

St.  Louie,  Missouri:  McDonnell  Douglas,  MDC  J6662/01,  December,  1975. 

This  report  describes  the  rcaulta  of  a  preliminary  investigation  of  two  types 
of  mental  workload  (MWL) :  Time-sharing  decisions  and  short-term  memory  (STM). 
Subjects  were  tested  in  a  multiple-task  situation  that  required  them  to  monitor 
either  four  or  six  single-digit  light-emitting  diode  (LED)  counters  to  prevent 
errors  (counts  above  nine  indicated  by  a  displayed  decimal  polnv  >  by  reset 
actions  taken  in  a  keyboard.  The  results  of  this  study  suggest  the  complexity 
of  time-sharing  or  self-scheduling  decisions  may  be  quantified  by  the  number 
of  alternatives  or  channels  being  monitored,  and  the  amount  of  processing  may 
be  quantified  In  terns  of  the  frequency  of  the  decisions,  .'hoit-tera  memory 
demands  may  be  quantified  in  terms  of  the  number  of  separate  items  or  groups, 
(chunks)  of  elements  to  be  stored  in  memory  and  the  duration  of  the  storage 
interval. 

W/L  Cat.  Code:  2.2.1 

Op.  Lehav .  Code:  1.,  2.,  4.1 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 


White,  R.  T.  and  Game,  J.  .  Mental  workload  assessment.  III.  Laboratory 
evaluation  of  one  subjective  and  two  physiological  measures  of  mental 
workload.  St.  Louis,  Missouri:  McDonnslI  Douglas  Corporation,  Report 
MDC  J7024/01,  December,  1975. 


A  laboratory  evaluation  vea  conducted  on  two  physiological  measures  and  one 
subjective  technique  for  the  assesement  of  mental  workload  (MJL) .  Twelve  Ss 
were  tested  in  a  multiple-task  situation  in  which  they  monitored  four  single- 
digit,  light  emitting  diode  (LED)  counters  to  prevent  errors  (i.e.,  counts 
above  9,  Indicated  by  displayed  decimal  points) .  MWL  in  terms  of  decisions  per 
minute  was  varied  by  changing  the  rates  at  which  individual  LEDs  Increased  their 
counts.  Subjects  also  performed  a  secondary  task  which  required  them  to  monitor 
ana  report  the  degree  of  stress  they  were  experiencing.  Physiological  measures 
recorded  throughout  the  test  included  integrated  pulse  volume  (IPV) ,  Integrated 
respiration  volume  (IRV) ,  GSR,  EKG,  and  pulae  and  respiration  waveforms.  These 
results  support  the  use  of  IPV  and  IRV  in  MWL  assessment  but  further  tests  are 
needed  to  determine  their  sensitivity  and  ranse  of  application.  Subjective 
estimates  of  stress  levels  did  not  appear  to  degrade  performance  and  are 
potentially  valid  and  reliable  indications  of  MWL  levels. 


W/L  Cat.  Code: 

Op  Behav.  Code: 

Opinion 

Spare  m  capacity 
Physiological 


1.1,  2.2.1,  4.1.2,  4.1,3,  4.1.10,  4.1.11 
1.,  2.,  4.1 

Multiple  Experimental  Laboratory 


Plight  simulator 
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White,  R.  T.  and  Warn,  C.  T.  Prediction  of  human  operator  performance  in  the 
design  of  command  and  control  systems.  Paper  4 resented  at  the  Annual  Moating 
of  the  Western  Psychological  Association,  Vancouver,  British  Coluabia, 

June  21,  1969.  (Douglas  Prper  5539). 

Military  contend  and  control  operations  of  manned  interceptors  were  analysed 
to  define  typical  tactical  and  air  defense  missions  and  the  tank  loading  on 
human  operators  who  control  these  missions.  Man-machine  functions  were 
analysed  In  systems  where  information  Is  computer- bast'd  to  describe  the 
control,  display,  and  communication  requirements  for  the  study.  Volunteer 
military  subjects  ware  trained  to  perform  the  required  tasks,  and  their 
performance  under  gradually  increasing  load  (information  handling  and 
processing)  conditions  was  measured  in  terms  of  time  and  correctness  of 
voice  messages  transmitted  and  manual  switch  actions  completed.  The  operator 
performance  data  obtained  in  this  study  nave  been  Interpreted  for  uoe  in  the 
following  areas  of  design  applicability:  Operator  Task  Performance  Times; 
Performance  Decrement;  and  Number  of  Operators  Required. 

W/L  Cat.  Code:  2.1.1,  3.1 

Op,  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  ra.  capacity  Task  comp..  Experimental  Simulator  Plight  simulator 

time  assess, 

Primary  task  Single  measures 


Wickens-,  C.  D.  The  effect  of  time  sharing  on  the  performance  of  information 
processing  tasks:  A  feedback  control  analysis.  Ann  Arbor,  Michigan:  The 
University  of  Michigan,  Human  Performance  Center,  Technical  Report  No.  51, 
August,  1974.  (ADA012023). 

Usually  the  effects  of  diverted  attention  cn  task  performance  is  assessed  either 
by  very  global  measures  or  by  the  highly  specific  measure  of  an  Increase  in 
processing  time.  There  is  evidence,  however,  that  other  effects  of  diverted 
attention,  such  a c  an  increase  In  internal  processing  noise,  or  a  cognitive  change 
in  processing  strategy,  exist,  but  may  only  be  revealed  by  a  more  detailed  analysis 
of  task  performance.  The  purpose  of  the  current  research  was  to  examine  these 
time-sharing  effects  in  a  manual  tracking  paradigm,  employing  the  fine-grained 
analysis  provided  by  the  techniques  of  feedback  control  theory ,  Subjects  each 
performed  three  information-processing  tasks  under  seven  time-sharing  conditions. 
Each  teak  was  performed  singly,  and  in  combination  with  one  and  with  both  of  the 
other  two  tasks.  Tie  results  indicated  that  all  tasks  chowed  both  performance 
decrements  and  processing-noise  increases  under  some  time-sharing  conditions. 
Time-sharing  interference,  however,  was  most  evident  between  the  response  aspects 
cf  the  tasks,  and  the  noise-level  Increase  in  the  tracking  task  was  concluded  tc 
result  from  motet,  rather  than  perceptual,  processing  interference. 


W/'L  Cat.  Code: 

.  .  ^  .  £•  .  t-  ,  J  • 

3 

Op.  Behav.  Code: 

1. ,  2. ,  4. 

Spare  m,  capacity 

Subsidiary  task 

Experimental  Laboratory 

Flight  simulator 

Primary  task 

Math,  model 

Review* 

Flight  test 
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Wicksns,  C.  D.  The  effects  of  divided  attantlon  on  Information  processing  in 
manuel  tracking*  Journal  of  Experiment*!  Psychology.  1976,  2^,  1-13. 

Six  aubjecta  performed  a  annual  tracking  task  concur rantly  with  each  of  two 
secondary  tasks:  an  input  tack  (auditory  signal  datactlon)  and  an  output 
taak  (application  of  a  constant  force) ,  A  feedback-control  analysis  of 
tracking  performance  was  utilised  to  analyse  the  tine-sharing  decrements 
observed  In  mean  squared  error,  in  terms  of  componente  due  to  processing 
delay,  addition  of  internal  processing  noise,  and  change  in  response  bias 
(tracking  gala) .  The  results  indicated  that  only  the  parameters  measuring 
noise  end  gain  were  sensitive  to  time -sharing  conditions,  and  these  only  to 
concurrent  performance  of  ths  force  application  teak.  Ii.  v^^  concluded  that 
limits  of  attention  In  duel-teak  performance  ere  more  severe  in  output  then 
in  input  stages  of  procenaing,  but  that  these  limits  ere  not  necessarily 
those  of  e  single-channel  bottleneck.  Instead,  e  broader  conception  of 
attention  is  proposed:  one  that  Includes  changes  in  processing  noise  and 
r'nifts  in  response  bias,  as  attention-related  phenomena. 

W/L  Cat.  Code:  2.2.1,  2.2.2 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Spare  m.  capacity  Subsidiary  task  Construct  Laboratory  Flight  simulator 
Primary  task  Single  measures  Experimental  Flight  test 


WicRens,  C. D.  Measures  of  workload,  stress  and  secondary  tasks.  In  N.  Moray 
(Ed.)  Mental  workload:  its  theory  and  measurement .  New  York:  Plenum  Press, 
1979,  79-99. 

The  concept  of  operator  workload  is  defined  in  terns  of  the  human's  limited 
processing  resources.  Operator  workload  scales  monotonically  with  the  extent 
to  which  the  tasks  performed  by  the  operator  utilise  these  limited  resource*. 

It  Is  asserted  that:  (1)  processing  resources  are  demanded  by  a  task  to  the 
extent  that  the  performance  of  a  second,  independent  task  performed  concurrently 
deteriorates  from  its  single  task  level.  (2)  Changes  in  the  objective 
characteristics  of  a  task  wili.  vary  the  processing  resources  demanded  by  its 
performance  at  a  constant  le\el,  to  the  extent  that  secondary  task  performance 
varies  concomitantly.  In  either  instance,  therefore,  the  manipulation  of  adding 
the  primary  task  or  of  changing  Its  characteristics  will  he  described  as  Increasing 
operator  workload  to  the  extent  that  secondary  task  performance  deteriorates. 

Tills  paper  reviews  the  advantages  and  disadvantages  of  «  wide  variety  of  workload 


estimation  techniques. 

W/L  Cat.  Code:  2.2,  3,,  4.0 

Op.  Behav.  Code:  1.,  2.,  4. 
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Wickens,  C.  D.  The  structure  of  sttentional  resources,  In  R.  Nickerson  (Ed.) 
Attention  end  Per foraence  VIII.  Hillsdale,  New  Jersey;  Lawrence  Erlbaun  and 
Assoc.,  1979.  (In  press. i 

Structural  end  capacity  theories  of  dual  task  performance  are  contrasted  and  a 
hybrid  conception  of  structure-specific  capacity  la  proposed  In  which  processing 
resource  reservoirs  are  defined  by  processing  structures.  A  review  of  the 
literature  Identifies  candidates  for  structural  resource  reservoirs,  defined  by 
Input  and  output  modalities,  stages  of  proceeslng,  and  hemispheres  of  processing. 
An  experiment  is  reported  In  which  encoding  end  response  modalities  of  a  digit 
processing  task  are  varied,  as  it  is  time-shared  with  a  tracking  task,  whose 
difficulty  is  manipulated.  The  results  are  interpreted  in  terms  of  the  concepts 
of  capacity,  structure,  and  resource  pools. 

W/L  Cat.  Code:  2.2.1,  3.1 

Op.  fiehav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Review  Laboratory  Background 

Primary  task  Single  measures  Experimental 


Wlckens,  C.  D.  and  Gopher,  D.  Control  theory  measures  of  tracking  as  indices 
of  attention  allocation  strategies.  Human  Factors,  1977,  19,  349-365. 

In  an  intelligent  man-machine  control  system,  control  theory  measures  describing 
the  operator's  tracking  performance  can  provide  useful  Information  concerning 
an  operator's  sttentional  state.  This  information  may  be  used  to  implement 
adaptive  aiding  procedures.  Research  is  reviewed  that  relates  artentional 
manipulations  to  variation  in  control  theory  parameters,  and  an  experiment  is 
then  described  in  which  29  subjects  performed  a  tracking  task  alone,  and 
concurrently  with  a  serial  reaction-time  task.  Within  the  time-sharing 
condition,  relative  priorities  between  the  two  tasks  were  manipulated.  The 
results  are  interpreted  in  terms  of  the  separate  effects  of  time-sharing  and 
of  priority  manipulations  upon  measures  of  tracking  gain,  remnant,  time-delay 
and  response  "holds,"  and  the  feasibility  of  on-line  measurement  of  those 
variables. 

4/L  Cat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  ns.  capacity  Subsidiary  task  Construct  Laboratory  Flight  simulator 
Primary  task  Single  measures  Experimental  Flight  test 
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Wickans,  C.  D.,  Taraal,  J.  and  Donchin,  E.  The  event  related  cortlca1  potential 
as  an  Index  of  task  workload ■  Proceed Inga  of  the  21st  Annual  Meet  ag  of  the 
Hunan  Factors  Society.  San  Francisco t  California,  1977,282-286 .  ~ 

This  paper  describes  sn  investigation  which  assessed  the  feasibility  of  the  event 
related  brain  potential  (ERP)  to  provide  an  index  of  operator  i  -trkload  in  adaptive 
man-machine  system# .  The  character iatlco  and  requirements  of  r  ich  systems  are 
described  and  some  limitations  of  secondary  task  workload  measures  enumerated. 

The  results  of  an  experiment  arc  then  presented  In  which  ERPs  were  recorded  from  10 
subjects,  while  the  difficulty  of  s  concurrent  tracking  task  was  varied.  Subjects 
performed  either  a  one  or  e  two  dimensional  compensatory  tracking  task,  while  ERP's 
were  elicited  by  presenting  discrete  auditory  stimuli.  The  amplitude  of  the  P300 
complex,  a  component  of  the  ERP,  elicited  by  the  stimuli,  decreased  from  the 
control  condition  (no  tracking)  to  the  tracking  conditions.  An  ERP  based  measure 
of  sequential  processing  of  the  stimuli  was  further  affected  as  tracking  difficulty 
was  Increased  from  1  to  2  dimensions.  An  algorithm  for  obtaining  an  on-line  ERP 
based  measure  of  workload  is  then  described. 

W/L  Cat.  Code:  3.1,  4.1.6 

Op .  Behav .  Code :  1 . ,  2 . ,  3 . ,  4 

Primary  task  Single  measures  Experimental  Laboratory  Flight  simulator 
Physiological  ECP  Flight  test 


Wickens,  C. ,  Israel,  J.,  McCarthy,  G. ,  Gopher,  D,  and  Donchin,  E.  The  use  of 

event-related  potentials  in  the  enhancement  of  system  performance.  Proceedings 
of  the  12th  Annual  NASA-Univereity  Conference  on  Manual  Control,  University  of 
Illinois,  May,  1976,  124-134.  (NASA  TM  X-73,  170). 


Advancing  computer  technology  has  facilitated  the  implementation  of  on-line 
adaptive  man-machine  systems.  In  these  systems,  computer  decisions  based  on 
information  concerning  the  state  of  the  operator  can  affect  the  nature  of  the 
man-machine  interaction.  Some  limitations  of  performance  measures  as  sources 
to  provide  information  to  the  computer  are  presented.  It  is  suggested  that  psy- 
chophysiologlcal  measures  such  as  the  event  related  cortical  potential  (ERP) 
may  be  utilized  to  bypass  these  limitations.  The  characteristics  of  the  ERP 
and  experimental  demonstrations  of  its  sensitivity  to  attentional  manipulations 
arc  described  and  a  program  of  relevant  research  Is  than  outlined. 


W/L  Cat.  Code:  2.2.2,  4.1.6 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 


Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory 


Flight  simulator 


Physiological  ECP 


Flight  test 
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Wickens,  C.  D.  and  Kassel,  C ,  The  effects  of  participatory  mode  and  task  workload 
on  the  detection  of  dynamic  system  failures.  Proceedings  of  the  13th  Annual 
NASA-Univeraity  Conference  on  Manual  Control,  Massachusetts  Institute  of  Technology, 
June  15-17,  1977,  126-135. 

The  ability  of  cperators  to  detect  step  changes  in  the  dynamics  of  control  systems 
is  investigated  as  a  joint  function  of,  (a)  participatory  node:  whether  subjects 
are  actively  controlling  those  dynamics  or  are  monitoring  an  autopilot  controlling 
theru,  and  (b)  concurrent  task  workload.  A  theoretical  analysis  of  detection  in 
the  two  modes  identifies  factors  that  will  faver  detection  in  either  mode.  Three 
subjects  detected  system  failures  in  either  an  autopilot  or  manual  controlling 
mode,  under  single-task  conditions  and  concurrently  with  a  "subcritical"  tracking 
task.  Latency  and  accuracy  of  detection  were  assessed  and  related  through  a  spoed- 
acccracy  tradeoff  representation.  It  was  concluded  that  failure  detection 
performance  was  better  during  manual  control  than  during  autopilot  control,  and 
that  the  extent  of  this  superiority  was  enhanced  as  dual-task  load  increased. 

Ensemble  averaging  and  multiyle  regression  techniques  were  then  employed  to 
investigate  the  cues  utilized  by  the  subjects  in  making  their  detection  decisions. 

W/L  Cat,  Code:  2.2.2.  3.1 

Op  Behav.  Code:  1.,  2,,  A. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Wickens,  C.  D. ,  and  Ke3sel,  0.  The  effects  of  participatory  mode  and  track 
workload  on  the  detection  of  dynamic  system  lailurts.  ISLE  Transact long  on 
Systems,  Man,  end  Cybernetics,  1979,  SMC-9,  24-34. 

The  ability  of  operators  to  detect  step  changes  ir  th^  order  of  control  dynamics 
is  investigated  as  a  joint  function  of  a)  participatory  mode,  whether  subjects 
are  actively  controlling  those  dynamics  or  are  monitoring  an  autopilot  controlling 
them,  and  b)  concurrent  'cask  workload.  Five  subjects  either  tracked  or  monitored 
the  system  dynamics  on  a  two-dimensional  pursuit  display  tmdev  single  task  conditions 
and  concurrently  with  a  ’’subcritical"  tracking  task  at  two  difficulty  levels. 
Detection  performance  was  faster  and  only  slightly  less  accurate  in  the  manual 
as  opposed  to  the  autopilot  mode.  Performance  in  each  mode  was  derogated  by  the 
concurrent  tracking  requirement,  but  not  by  increases  in  loading  task  difficulty. 
Further  analysis  indicated  that  manual  superiority  was  attributable  to  the 
addit  onel  proprioceptive  information  resulting  from  operator-control  adeptatio.i 
to  the  system  change. 

W/L  Cat.  Code:  2.1.2,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  rn.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 

Primary  task  Single  measures 
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Wickens,  C.  D.  and  Pierre,  B.  Attentlonal  resource  allocation  in  a  variable 
difficulty  dual  task  paradigm.  Urbana-Charapaign,  Illinois:  Engineering 
Psychology  Laboratory,  University  of  Illinois,  Technical  Report  AFOSR-78-1/ 
EPL-78-1,  February,  1977.  (AD  A059  463). 


A  mode-1  of  the  attention  allocation  process  in  a  dynamic  environment  with  changing 
task  demands  is  presented.  Eight  subjects  then  time-shared  two  compensatory 
tracking  tasks  under  conditions  of  constant  task  difficulty,  and  tinder  conditions 
when  the  difficulty  of  one  task  was  varied  over  the  course  of  the  trial.  Subjects 
were  instructed  to  maintain  constant  performance  on  the  variable  difficulty  task, 
and  augmented  performance  feedback  was  presented  on  half  of  the  trials  The  data 
were  evaluated  in  terms  of  the  model,  anti  coherence  and  error  analysis  revealed 
that  allocation  was  far  from  optimal.  The  failure  of  au'nnented  feedback  to 
improve  the  optimality  of  allocation  suggested  thet  the  limitation  lay  within  the 
allocation,  rather  than  the  demand  evaluation  process.  Some  reasons  ars  oropossd 
for  these  limitations,  and  for  the  contrast  of  the  current  results  with  optimum 
allocation  observed  in  constant  difficulty  dual  task  studies. 


W/L  Cat.  Code: 

Gp.  Behav.  Code: 
Spare  m.  capacity 
Primary  task. 


2.2,  3.1 
1.  ,  2.  ,  4. 

Subsidiary  teak  Experimental 
Single  measures 


Laboratory 


Background 


Wickens,  C.  D.  and  Tseng,  P.  Attention  allocation  in  dynamic  environments. 

University  of  Illinois  (Urbana-Champaign)  Engineering  Psychology  Research 

Laboratory,  Tecnnical  Report  EPL-V9-3/AFOSR-79-3,  June,  1979. 

Three  policies  of  attention  resource  allocation  between  tasks  of  dynamically 
varying  difficulty  are  described.  These  policies  optimal  allocation,  optimal 
resource  expansion,  and  non-optimal  allocation  are  distinguished  analytically 
by  the  gain  of  the  transfer  function  between  task  difficulty  and  primary  and 
secondary  task  performance.  Eight  subjects  time-shared  two  compensatory  tracking 
tasks  in  which  the  control  dynamics  of  the  primary  task  fluctuated  continuously 
between  first  and  second  order.  The  difficulty  and  filtered  RMS  error  performance 
measures  indicated  that  subjects  were  initially  non-optimal  in  their  allocation 
policy,  failing  to  guard  the  primary  task  in  the  face  of  fluctuations  in  its 
difficulty.  With  practice,  a  trend  toward  more  optimal  performance  was  observed. 
Clone  analysis  and  comparison  of  the  variable  difficulty  data  with  performance 
in  constant  difficulty  dual  task  conditions  indicated  a  persisting  limitation  in 
subjects'  ability  to  reallocate  resources  from  the  secondary  task  when  requir«d 
by  demand  changes  of  the  primary.  The  source  of  this  limitation  was  postulated 
to  reside  in  the  difficulties  operators  encounter  when  maintaining  two  concurrent 
and  dissimilar  describing  functions. 


W/L  Cat.  Code: 

2.2.2,  2.2.5,  3.1,  3.3 

Op .  Behav ,  Code : 

1.,  2.,  4. 

Spare  m.  capacity 

Subsidiary  task  Experimental  Laboratory 

Flight  simulator 

Primary  task 

Single  measures 

Math,  model 
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WIckens,  C.  D. ,  Tseng,  P.  S.,  and  Banal,  R.  A,  The  allocation  of  attentlooel 
resources  in  s  dynamic  environment.  Proceedings  of  the  23vd  Annual  Meeting 
of  the  Human  Factors  Society,  Boston,  Massachusetts,  October  29- November 
1979,  527-531. 

Three  experiments  are  reported  in  which  subjects  performed  a  primary  task,  whose 
difficulty  varied  quasi-randomly  over  time,  concurrently  with  a  secondary  task, 
whose  difficulty  remained  constant.  'Rime  models  of  resource  allocation  v^re 
described  which  varied  in  the  degree  of  optimality  with  which  operators  can  laobilize 
resources  in  response  to  the  demand  changes.  These  are  quantified  by  linear  time-* 
series  analysis.  In  experiment  1  employing  two  tracking  tasks,  allocation  behavior 
was  non-optimal,  but  indicated  a  trend  toward  optimality  with  practice.  In 
experiment  2  when  tracking  difficulty  was  varied  concurrently  with  a  dynamic  Bystem 
monitoring  task,  behavior  was  somewhat  optimal.  In  experiment  3  which  again  paired 
tracking  and  monitoring,  but  varied  monitoring  task  demand,  resource  allocation 
was  extremely  non-aptiroal .  Some  reasons  lor  this  departure  from  optimality  ere 
considered. 


W/L  Cat.  Code: 

Op.  Bshav.  Code: 
Spare  ra.  capacity 
Primary  task 


2.2.2,  2.^.5,  3.1 
1,,  2.,  4. 

Subsidiary  task  Experimental 
Sing  le  measures 


Laboratory 


Flight  simulator 


Wiener,  E.  L.  Controlled  flight  into  terrain  accidents:  system  induced  errors. 
human  Factors,  1977,  j^9,  171-181. 

Controlled  flight  into  terrain  accidentn  are  tltos  in  which  an  aircraft,  under 
the  control  cf  the  crew,  la  flown  into  tarrain  (or  watt r)  with  nc  prior  awareness 
cm  cho  part  of  the  crew  of  the  impending  disaster.  This  paper  examines  recent 
experience  with  these  accidents,  seeing  them  as  tha  result  of  errors  generated  by 
e  complex  air  traffic  control  system  with  maple  opportunities  for  system-induced 
errors.  Such  problem  areas  as  pilot-controller  communication,  flightdecit  workload, 
noise-abatement  procedures,  government  regulation,  visual  illusions,  and  cockpit- 
ond  ground- raaar  warning  devices  or*  discussed,  with  numerous  examples  of  recent 
accident  cases.  The  failure  of  the  hue-tn  factors  profession  to  play  a  more 
significant  role  in  tne  air  traffic  complex  is  also  considared. 

W/L  Cat.  Code:  3.1 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Primary  task  Single  measures  Review  None  Background 


324 

•  -•  *  ,•»*)<»>  »u.w-'4  -i* 


>i. 


SY-27R-80 


Wierwille,  W.  W.  Physiological  meat  ares  of  aircrew  mental  workload. 

Human  Factors,  1979,  21,  575-593, 

Physiological  measures  of  aircrew  mental,  workload  were  divided  into  fourteen 
specific  classes.  Each  class  was  then  summarised  in  tertn3  of  background, 
applications,  and  implications  for  research  and  implementation.  It  is  concluded 
that  several  physiological  measures  appear  promising,  but  that  more  research 
is  needed  to  provide  convincing  evidence  of  viability.  Physiological  techniques 
can,  however,  be  combined  with  other  workload  assessment  techniques  to  provide 
a  more  complete  understanding  of  the  workload  associated  with  given  aircrew 
tasks. 


W/L  Cat.  Code: 
Op.  Behav.  Code: 
Fhysio  logic**! 


4. 

1.,  2.,  3...  4. 
Multiple 


Re  vi  ew 


None 


Flight  simulator 
Flight  test 


Wierwille,  W.  W.  and  Gutmana,  J.  C.  Comparison  of  primary  and  secondary  task 
measures  as  a  function  cf  simulated  vehicle  dynamics  and  driving  conditions. 
Hu-ian  Factors,  1973,  20,  233-244. 

In  a  previously  reported  experiment  involving  a  moving  base  driving  simulator 
with  computer-generated  display,  secondary  task  measures  of  workload  showed 
significant  increases  as  a  function  cf  large  changes  in  vehicle  dynamics  ?>d 
disturbance  levels.  Because  the  secondary  task  measures  appeared  less  sensitive 
than  desired,  driving  performance  measures  recorded  furing  the  same  experiment 
were  later  analyzed.  Particular  emphisis  in  examining  the  driving  perfortnance 
data  was  placed  on  (1)  determining  the  degree  of  intrusion  of  the  secondary  task 
on  the  driving  task  as  a  function  of  the  independent  variables,  and  (2)  on 
comparing  the  sensitivity  of  the  primary  and  secondary  task  measures.  The 
results  showed  the  secondary  teak  does  intrude  significantly  upon  the  driving 
task  performance  at  low  workload  levels,  but  that  it  doee  not  significantly 
intrude  at  high  workload  levels.  Also,  *;heri  the  four  primary  task  measures 
were,  analysed  for  sensitivity  to  the  independent  variables,  new  information 
was  obtained  indicating  greater  sensitivity  than  is  obtained  with  the  single 
secondary  task  measure. 


W/L  Cat.  Code:  2.2.1,.  3.2 

Op,  Behav.  Code:  i. ,  2.,  4. 


Spare  m.  capacity  Subsidicry  task  Experimental  Simulator 
Primary  task  Mult,  moisures 


Illght  simulator 
flight  test 
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Wierwillc,  W.  W. v  Gutwonn,  J.C.,  Hicks,  T.  2.,  and  Kuto,  W.  H.  Secondary 
task  measurement  of  workload  as  a  f uuction  o£  simulated  vehicle  dynamics 
and  driving  conditions ,  Human  Factors,  1977  s  19,  557-565. 

A  driving  simulator  with  a  computer-generated  display  and  a  four  degree  of 
freedom  physical  motion  system  was  used  to  determine  the  sensitivity  of  e  secondary 
task  to  vehicle  handling  parameters  and  various  driving  conditions.  Six  subjects 
drove  a  simulated  vehicle  with  nontax  automobile  hondllrr  and  another  six  drove 
with  degraded  handling.  Steering  ratio  and  disturbance  level  uare  adjusted  within 
each  set  of  subjects.  A  secondary  task  consisting  of  rending  random  digits  aloud 
from  £  single-digit  dashboard  display  was  used  to  assess  workload.  It  was  found 
that  workload  increased  significantly  as  disturbance  level  Increased.  Furthermore, 
crorkload  Increased  significantly  with  degraded  vehicle  handling.  In  contrast. 
Increasing  steering  ratio  did  not  produce  a  signif leant  change  in  workload.  These 
results  indicate  that  the  secondary  task  method  can  be  used  to  assess  the  major 
effects  of  simulated  vehicle  handling  on  driver  workload.  Problems  remain, 
however,  in  designing  uore  sensitive  secondary- task  measures. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 

Spare  m.  capacity 

Primary  task 


2.2.1,  3.1 

1.,  7...  4. 

Subsidiary  txak  Experimental 
Single  measures 


Simulator 


Flight  simulator 


Wierwille,  W.  W.  and  Willi  gas,  B.  C,  Survey  and  analysis  of  operator  workload 
assessment  techniques.  Blacksburg,  Virginia:  Systemetrics,  Inc.  Report 
no.  S-78-101,  September,  3978. 


Over  400  references  relating  to  operator  mental  workload  were  selected  and 
classified  according  to  a  two-dimensional  scheme,  including  workload  methodology 
and  universal  operator  behavior.  Twenty-eight  specific  techniques  of  assessing 
workload  by  means  of  subjective  opinions,  spare  mental  capacity,  primary  task,  . 
and  physiological  measures  were  cataloged.  This  catalog  summarizes  critical 
criteria  that  need  to  be  considered  in  the  flight  test  and  evaluation  environment 
and  describee  each  technique  in  terms  of  theory  and  background,  description  of 
necessary  method/ apparatus,  area  of  application  and  example,  limitations,  and 
suggested  RDT&E  follow-ups. 


W/L  Cat.  Code: 

1. ,  2. ,  3. ,  4. 

Op.  Behav.  Code: 

i.,  2.,  3, ,  4. 

- 

Opinion 

Multiple 

Review 
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Spare  a>.  capacity 
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Philological 
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Wiervilla,  W.  5f.,  Williges,  R.  C. ,  and  Schiflctt,  S.  G.  Aircrew  workload 
aaaeaanent  techniques.  In  B.  0.  Hartman  and  R.  B.  McKenzie  (Eds.)  Survey 
of  methods  to  anseas  workload.  AGAR D- AG-246,  August,  1979,  19-53. 

A  classification  scheme  is  presented  which  sunaarites  a  survey  and  analysis  of 
aircrew  workload  assessment  techniques  relevant  to  inflight  test  and  evaluation 
considerations.  Two  dimensions  consisting  of  universal  operator  behaviors . and 
workload  assessment  methodologies  were  uted  in  the  classification  scheme.  The 
universal  operator  behaviors  were  classified  accordl  %  to  the  Berliner,  Angell, 
and  Shearer  (1964)  categories  including  perceptual,  mediations! ,  communication, 
and  motor  processes;  whereas  the  workload  assessment  methodologies  were  cataloged 
into  28  procedures  under  tha  general  categories  of  subjective  opinion,  spare  mental 
capacity,  primary  task,  and  physiological  measures.  An  applicability  matrix  based 
oh  this  classification  scheme  is  presented  which  summarizes  existing  research  on 
workload  assessment  methodologies,  and  a  bibliography  of  over  400  relevant  references 
is  provided  as  an  appendix  to  this  paper.  Procedures  are  described  whereby  this 
matrix  can  be  used  as  a  guide  for  selecting  candidate  aircrew  workload 
assessment  measures  for  inflight  evaluation. 


W/L  Cat.  Code: 

1  y  % 

4. 

Op.  Behav.  Code: 

1.,  2.,  3., 

4. 

Opinion 

Multiple 

Review 

None 

Flight  simulator 

Spare  m.  capacity 
Priwr.ry  task 
Physiological 

Construct 

Flight  test 

Wlldervanck,  C.,  Mulder,  G.  and  Michon,  J.  A.  Mapping  mental  load  in  car 
driving.  Ergonomics ,  1978,,  21,  225-229. 

A  system  is  being  developed  which  permits  the  identification  of  traffic 
locations  which  impose  a  heavy  mental  load  on  the  car  driver.  The  method 
employs  a  car  equipped  with  a  video-recorder,  of  which  the  camera  is  mounted 
behind  the  windscreen,  continuously  recording  the  independent  variable  of 
traffic  load.  Dependent  variables  are  physiological  indices  and  performance 
on  a  secondary  task.  This  working  report  is  a  review  of  the  factors  taken 
into  consideration  in  the  preparatory  phase  of  the  <ucperiments. 

W/L  Cat.  Code:  2.1.2,  2.2.2,  3.2,  4.1 

Op.  Behav.  Code:  1.,  2,,  4. 

Spare  m.  capacity  Multiple  Review  Field  Flight  simulator 

Primary  tusk  Flight  test 

Physiological 
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Williams,  C.  E.  and  Stevens,  K.  N.  Emotions  and  speech:  some  acoustical 
correlates.  Journal  of  the  Acoustical  Society  of  America,  1972,  52, 

1238-1250. 

This  paper  describes  some  further  attempts  to  identify  and  measure  those 
parameters  in  thfe  speech  signal  that  reflect  the  emotional  state  of  a  speaker. 
High-quality  recordings  were  obtained  of  professional  "method"  actors  reading  the 
dialogue  of  a  short  scenario  specifically  written  to  contain  various  emotional 
situations.  Excerpted  portions  of  the  recordings  were  subjected  to  both 
quantitative  and  qualitative  analyses.  A  comparison  was  also  made  of  recordings 
from  a  real-life  situation,  in  which  the  emotions  of  a  speaker  were  clearly 
defined,  with  recordings  from  an  actor  who  simulated  the  same  situation.  Anger, 
fear,  und  sorrow  situations  tended  to  produce  characteristic  differences  in  contour 
of  fundamental  frequency,  average  speech  spectrum,  temporal  characteristics, 
precision  of  articulation,  and  waveform  regularity  of  successive  glottal  pulses. 
Attributes  for  a  given  emotional  situation  were  not  always  consistent  from  one 
speaker  to  another. 

W/L  Cat.  Code:  4.3 

Op.  Behav.  Code:  1. ,  2.  ,  3. 

Physiological  Speech  patt.  Experimental  Laboratory  Background 

anal. 


Williams,  L.  W.  Feasibility  of  saliva  analysis  for  measuring  mental  stress 
in  man.  Master's  thesis,  Texas  A  &  M  University,  College  Station,  Texas, 

1  ATI  /*»▼>.  -»  /  T  A  \ 

j.9/1  \AD  /«♦/  o/j.)* 

Tiie  purpose  of  the  investigation  was  to  determine  the  usefulness  of  the  parotid 
fluid  analysis  technique  in  measuring  mental  stress.  Ten  subjects  were  used  in 
the  experimental  portion  of  this  work.  Three  levels  of  stress  were  used.  A  low 
stress  level  was  taken  with  the  subjects  at  rest.  The  medium  and  high  stress 
levels  were  set  up  using  30  and  60  revolutions  per  minute  respectively  on  a 
rotary  pursuit  tracking  task.  Parotid  fluid  was  collected  for  a  30  minute  period 
at  each  of  the  three  stress  levels  for  each  subject.  The  chemical  analysis  of 
the  parotid  fluid  was  carried  out  to  determine  the  concentrations  of  corticosteroids 
(17-OHCS)  in  the  parotid  fluid  samples.  Mathematical  analysis  of  the  data 
indicated  that  there  was  no  change  in  the  17-OHCS  level  as  a  result  of  increased 
stress  levels.  The  results  were  attributed  to  using  a  tracking  task  lacking 
sufficient  difficulty  to  produce  mental  stress. 

W/L  Cat  Code:  4.1.12 

Op.  Belav.  Code:  1.  ,  2. ,  4. 

Physiological  Body  'fluid  Experimental  Laboratory  Flight  simulator 

anal. 


SY-27R-80 


Williges,  R.  C.  and  WierwiXle,  W.  W.  Behavioral  measures  of  aircrew  mental 
workload.  Human  Factors.  1979,  21,  549-574, 

Behavioral  research  literature  pertaining  to  the  measurement  of  aircrew  workload 
was  classified  Into  general  categories  of  subjective  opinion,  spare  mental  capacity, 
and  primary  task  metrics.  Fourteen  specific  classes  of  workload  measures  related 
to  these  general  categories  were  reviewed  specifically  in  regard  to  aircrew  work¬ 
load  assessment  in  the  flight  test  and  evaluation.  Bach  class  of  measures  was 
summarized  in  terms  of  background,  applications,  and  implications  for  research 
and  implementation.  It  was  concluded  that  no  one,  single  measure  can  be 
recommended  as  the  definitive  behavioral  measure  of  mental  workload.  Due  to  the 
multidimensionality  of  workload,  it  appears  that  the  most  promising  assessment 
procedure  should  include  multiple  measures  of  subjective  opinions,  spare  mental 
capacity,  and  primary  task  measures  as  well  as  physiological  correlates. 


W/L  Cat.  Code: 

1. ,  2.  ,  3. 

Op.  Behav.  Code: 

1. ,  2. ,  3. ,  4. 

Opinion 

Multiple  Review 

None 

Flight  simulator 

Spare  ra.  capacity 

Flight  test 

Primary  task 

Winger t,  J.  W.  Function  Interlace  modifications  to  analytic  workload 

predi  -i.w ■.  In  K.  D.  Gross  and  J.  J.  McGrath  (Eds.)  Crew  System  Design. 

Sant*.  ’V’-bara,  California :  Anacapa  Sciences,  July,  1973. 

Anal,  -  'rediction  of  operator  workload  has  been  used  to  evaluate  the  result 
of  alli^  ;ing  functions  to  human  operators  for  a  specific  system  concept.  A 
conanon  workload  definition  used  is  the  ratio  of  time  needed  to  perform  all 
required  tasks  to  the  time  available.  This  technique  has  proved  useful  in  that 
system  concepts  which  impose  excessive  workload  demands  on  the  operator  can  be 
abandoned  early  in  the  development  cycle.  The  usual  techniques  involve  task 
analysis,  with  performance  time  prediction  based  on  eye-movement  data,  information 
processing  time  data  and  time  and  motion  data.  The  human  is  typically  modeled 
as  a  single -channel  device.  The  results  are  quite  conservative  if  complex  well- 
practiced  tasks  arr  ‘«voi.  Function  interlace  provides  a  model  which  permits 
time-shaving  o  .entir  capacity  to  yield  workload  predictions  more  closely 
in  agreement  with  simulation  workload  data.  The  theory  is  not  as  yet  substantially 
developed,  although  :iome  validating  laboratory  measurements  have  been  made. 

W/L  Cat.  Code:  2.1.1 

Op.  Behav.  Code:  1.,  2.,  3. 

Spare  m.  capacity  Task  comp..  Construct  Flight  simulator  Flight  simulator 

time  assess. 

Flight  test 
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Wisnei,  A.  Electrophysiological  measures  for  tasks  of  low  energy  expenditure. 

In  W  T.  Singleton,  J.  G.  Fox,  and  D.  Whitfield  (Eds.)  Measurement  of  man 
at  work.  London:  Taylor  and  Francis,  1973,  61-73. 

Having  no  good  measure  of  the  energy  aspect  of  brain  activity,  researchers  have 
recorded  and  evaluated  the  electrical  activity  of  the  brain  and  some  physiological 
functions  which  are  sure  or  less  faithful  images  of  central  activity.  In  early 
studies  technical  difficulties  restricted  interest  to  certain  variables  and 
experimental  conditions,  and  the  resulting  interpretations  are  not  of  little 
importance.  Many  people  no*,  prefer  to  measure  both  in  laboratory  experiments  end 
In  the  field  and  the  classification  of  work  situations  in  terms  of  a  single  scale 
of  arousal  is  no  longer  accepted.  As  well  as  estimating  the  cost  of  high  or 
low  extremes  of  activation,  we  must  also  determine  the  orientation  of  attention 
towards  different  aspects  of  the  work  situation.  Only  thus  can  physiological 
measures  be  of  any  use  in  the  study  of  man-machine  systems. 

W/L  Cat.  Code:  4,1.3,  4.1.4,  4.1.5,  4.1.6,  4.1.7,  4.1.10 

Op.  Behav.  Code:  1.,  2.,  4. 

Physiological  Multiple  Review  Laboratory  Flight  simulator 


Wolf,  J.  D.  Workload  evaluation  of  control-display  configurations  for  approach 
to  landing.  Minneapolis,  Minnesota:  Honeywell,  SRC  Report  F0548-IR,  August, 
1977. 

The  program  objective  is  to  develop  a  quantitative  measure  of  information  processing 
workload  for  evaiuation  of  alternative  flight  control  and  display  configurations. 
Simulator  tests  described  below  are  designed  to  support  this  objective  by  providing 
operator  response  data  and  analysis  results: 

To  show  that  physiological  and  performance  measures  can  be  combined  to  predict 
information  processing  task  difficulty. 

To  show  the  relative  predictive  merits  of  different  combinations  of  measures. 

To  show  the  generality  of  physiological  measures  in  predicting  information 
processing  workload. 

To  compare  the  relative  sensitivities  of  different  methods  of  evaluating 
cockpit  systems. 

W/L  Cat.  Code:  4.1.3,  4.1.4,  4.1.7,  4.1.11 

Op.  Behav.  Code:  1.1,  2.2.1,  3.2.,  4. 

Opinion  Multiple  Experimental  Flight  simulator  Flight  simulator 

Spare  m.  capacity  Flight  test 

Primary  task 
Physiological 
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Wolfe,  J.  D.  Crew  workload  assessment- development  of  a  measure  of  operator 

workload.  Wright-Pstterson  Air  Force  B«3e,  Ohio:  Flight  Dynamics  Laboratory. 
Final  Technical  Report,  AFFDL-TR-78-165,  December,  1978. 

The  study  objective  was  to  develop  a  quantitative  measure  of  workload  useful  in 
crewstation  evaluation.  Flight  tasks  of  varying  difficulty  were  simulated,  and 
35  piloc  response  variables  analyzed.  Selected  physiological  and  visual  response 
variables  were  applied  in  a  stepwise  regression  procedure  to  the  prediction  of 
a  composite  performance /opinion  measure,  which  reflected  differing  levels  of 
task  difficulty.  The  resulting  linear  equation  was  reformulated  as  a  preliminary 
operationally-defined  mea  ure  of  Informs tion-procer3ing  workload. 

W/L  Cat.  Code:  1.1,  2.2.1,  3.2,  4.1.3,  4.1.4,  4.1.7,  4.1.8,  4.1.10,  4.1.11,  4.2 

Op.  3ehav.  Code:  1.,  2.,  4. 

Opinion  Multiple  Experimental  Flight  simulator  Flight  simulator 

Spare  m.  capacity 
Primary  task 
Physiological 


Wong,  P.  .T.,  Coulurie,  G.  J.,  and  Schmidt,  D.  K.  Aggregate  flow  model  for 

evaluating  ATC  planning  strategies.  Journal  of  Aircraft,  1977,  ^14,  527-532. 

An  aggregate  traffic  flow  model  is  developed  and  used  to  evaluate  the  potential 
benefits  of  automated,  facility-level,  on-line  air  traffic  flow  control.  The 
model  monitors  and  dynamically  adjusts  traffic  flow  rates  and  traffic  densities 
on  the  routes  in  the  ATC  network.  The  route  flow  adjustments  are  based  on 
controller  workload  criteria,  with  the  intent  of  eliminating  'ra'fic  serges  and 
the  associated  periods  of  excessive  workload.  The  model  is  used  to  evaluate 
two  flow  control  strategies  with  respect  to  aircraft  delay,  controller  wcrklcad, 
and  staffing  considerations. 


W/L  Cat.  Code:  2.1.1,  3.3 

Op,  Behav.  Code:  1.,  2.,  3.,  4. 


Spare  m.  capacity  Task  comp. , 

time  assess. 

Primary  task  Math,  model 


Experimental  Field 


Background 
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Ycshltake,  3.  Three  characteristic  patterns  of  subjective  fatigue  symptoms. 
Ergonomics ,  1978,  23,  231-233. 

An  extensive  field  survey  of  subjective  symptoms  of  fatlgre  .evealed  three 
characteristic  patterns.  One,  in  which  'dtowjlneso  and  dullness'  produmim  ted, 
was  frequent  both  among  those  who  lcported  many  symptoms  and  those*  who  reported 
few  and  was  not  characteristic  of  any  particular  type  of  wurk.  A  second,  in 
which  "inability  to  concentrate"  was  prominent,  was  more  frequent  among  those 
who  reported  toauy  symptom*.  and  was  characteristic  of  mental  workeis,  especially 
after  night  work.  A  tnlrd  pattern,  in  which  awareness  of  physica  discomfort 
was  characteristic,  was  found  nnioly  among  those  who  reported  fev  symptoms  and 
were  engaged  its  physical  work, 

W/L  Cat.  Code:  1.2 

Op.  Behav.  Code:  2.,  3.,  4. 

Opinion  Interview  Experimental  Field  Flight  simulator 


Zaitzeff,  L.  P.  Aircrew  task  loading  in  the  Boeing  multimission  simulator. 
Proceedings  of  the  5fcth  AGARD  Conference  on  Measurement  of  Aircrew 
Performance.  Brooks  Air  Force  Base,  Texas,  May, 1969,  pp.  8-1  to  8-3. 

The  Boeing  Company's  new  multimission  simulator,  combining  a  1CC°  "real-world" 
visual  display  in  high-resolution  color,  together  witn  a  completely  functional 
and  correlated  cockpit,  is  described.  The  simulate,  permits  aircrews  to  tvuin 
in  proposed  aircraft  and  avionics  systems  and  fly  real-time  missions  over  a 
specially  designated  are^.  of  the  United  Stetec.  The  simulator  was  designed 
to  evaluate  aircrew  performance,  using  state-of-the-art  concept**,  controls, 
and  d  splays  incorporated  in  the  cockpit  of  an  advance*  fighter/ '.attack 
aircraft  Visual  target  acquisition  per.fi  r^ance  was  used  us  a  measure  of 
task  loading  in  tests  of  one-  and  two-man  crews  flying  both  realistically 
task-loaded  missions  and  ssruear.es  requiring  visual  target  acqulstion  only. 

Visual  target  acquisition  performance  of  tuo-man  crew*  was  cignifit antly 
better  than  that  of  one-man  crews  in  loth  typer  of  flights, 

W/I.  Cat.  Code:  2.2.1,  3.1 

Op.  Behav  Code:  1.,  2.  .,  4.2 

Scare  m.  capacity  Subsidiary  task  Experimental  Flight  simulator  Flight  simulator 
Primary  task  Single  tenures 
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Z* ier,  H.  Concurrent  physiological  activity  of  driver  and  passenger  when 
driving  with  and  without  automatic  transmission  In  heavy  city  traffic. 

Ergonomics ,  1979,  22,  799-810. 

Twelve  subjects  were  selected  for  a  comparison  of  driver  and  passenger  reactions 
in  vehicles  with  automatic  transmission  and  with  manual  transmission.  Each  subject 
underwent  four  test  runs,  as  a  driver  and  as  a  passenger  with  each  transmission. 
During  the  tests,  skin  conductance  (SuL  and  SCR),  EMG  from  the  frontalis  muscle 
and  2CG  were  recorded  from  both  the  driver  and  the  passenger.  Urine  samples  were 
taken  to  measure  catechol amine  excretion.  The  test  driving-circuit  was  about 
14  km  in  length  and  each  test  run  consisted  of  four  complete  circuits.  In  drivers, 
significant  differences  were  only  found  between  driving  with  automatic  and  manual 
transmission.  When  driving  with  manual  transmission,  rate  of  adrenaline  excretion, 
skin  conductance  tccivity  (SCR),  heart  rate  and  heart  rate  variability  were 
significantly  higher  than  when  driving  with  automatic  transmission  or  when  riding 
as  a  passenger.  Between  the  latter  two  conditions  there  were  no  significant 
differences  with  respect  to  these  variables. 

W/L  Cat.  Code;  4.1.2,  4.1.3,  4.1.4,  4.1.9,  4.1.10 

Op.  Behav.  Code:  1.,  2.,  3.,  4. 

Physiological  Multiple  Experimental  Field  Flight  simulator 

Flight  test 

Zeitlln,  L.  R.  and  Finkelman,  J.  M.  A  "random  digit"  generation  subsidiary  task 
measure  of  operator  perceptual-motor  loading.  Experimental  Publication  Syatem. 
August,  1969,  3^  MS.  So.  Q35-B. 

"Spare  capacity"  measures,  while  indirect,  offer  a  means  of  comparing  control-display 
configurations  in  the  less  extreme  range  of  operating  conditions,  before  overt  errors 
occur,  cad  as  such  can  be  useful  in  field  research  in  automotive  and  aircraft  safety 
where  extreme  operating  conditions  may  be  dangerous.  Spare  capacity  is,  in  most 
instances,  determined  by  noting  the  degradation  of  performance  on  a  secondary  task 
while  the  operator  holds  primary  task  performance  constant.  Because  of  the  field 
conditions  in  which  most  of  the  studies  in  this  area  were  performed,  primary  task 
analysis  and  subsidiary  task  standardization  were  often  sacrificed  to  expediency. 
Random  digit  generation  was  utilized  in  this  study  as  a  subsidiary  task  measure  of 
the  loan  imposed  by  a  simple  perceptual  motor  tracking  function.  As  exDecfed, 
primary  task  performance  increased  with  practice  and  was  not  degraded  by  the 
introduction  of  the  subsidiary  task.  Scores  on  the  subsidiary  task  distinguished 
between  primary  task  load  and  no  load,  and  also  indicated  a  drop  in  information 
processing  load  as  primary  task  performance  approached  an  asymptote  after  exteuslve 
practice.  Although  the  present  subsidiary  task  may  be  somewhat  insensitive  to  small 
changes  in  loading,  upon  refinement,  it  should  prove  a  valuable  research  tool  in  the 
development  of  man-machine  systems  and  in  the  assessment  of  operator  information 
processing  requirements. 

VJ/L  Cat.  Code;  2.2.1,  3.3 
Op.  Behav.  Code:  1.,  3.,  4. 

'•>pa*e  m  capacity  Subsidiary  r«ak  Experimental 
Friwcry  task  Single  measures 
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Laboratory  Flight  simulator 
Flight  test 


Zeitlin,  L.  R.  and  Finkelaan,  J.  M.  Measurement  of  operator  loading  in  pursuit 
rotor  tracking  by  a  "random  digit"  generation  subsidiary  task.  Hoboken, 

New  Jersey:  Stevens  Institute  of  Technology,  Davidson  Laboratory,  Technical 
Report  R-1401,  August,  1969. 

Random  digit  generation  was  used  in  this  study  as  a  subsidiary- task  measure 
of  the  load  imposed  by  a  simple  perceptual-motor  tracking  function.  As  expected, 
primary-task  performance  Increased  with  practice  and  was  not  degraded  by  the 
introduction  of  the  subsidiary  task.  Scores  on  the  subsidiary  task  distinguished 
between  primary-task  load  and  no  load,  and  also  indicated  a  drop  in  information¬ 
processing  load  as  primary-task  performance  approached  an  asymptote  after 
extensive  practice.  Although  the  present  subsidiary  task  may  be  somewhat 
insensitive  to  small  changes  in  loading,  it  should,  upon  refinement,  prove  a 
valuable  research  tool  in  the  development  of  man-machine  systems  and  in  the 
assessment  of  operator  information-processing  requirements. 

W/L  Oat.  Code:  2.2.1,  3.1 

Op.  Behav.  Code:  1.,  2.,  4. 

Spare  n>.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 


Zeitlin,  L.  R.  and  Finkelman „  J.  M.  A  subsidiary  task  evaluation  of  the 

information  processing  load  in  a  vehicular  control  simulation.  Washington, 
DC.:  American  Psychological  Association,  Experimental  Publication  System, 
Issue  3,  Manuscript  No.  106B,  December,  1969. 

The  information  processing  load  imposed  upon  an  operator  by  compensatory 
tracking  in  a  basic  vehicular  control  simulation  was  measured  by  means  of  a 
"random  digit"  generation  subsidiary  task.  The  actual  degree  of  loading  was 
varied  through  manipulation  of  the  frequency  of  the  tracking  forcing  function 
and  the  order  of  the  control.  Performance  was  inversely  related  to  both 
tracking  frequency  and  control  order.  A  significant  interaction  was  lound 
between  the  tracking  frequency  and  the  control  order.  The  subsidiary  task 
clearly  distinguished  load  conditions  from  the  no-load  condition. 

W/'  oat.  Covie:  L’.2.1,  3.1,  3.3 

Ori.  Behav.  Code:  1.,  2.,  4. 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 

Math,  model 
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Zeltlin,  I..R.  and  Flnkalman,  J.M.  "omparison  of  "random  digit  generation"  and 
"delayed  digit  recall"  aa  subsidiary  teak  measures  of  operator  loading  in  man- 
machine  syptama.  Experimental  Publication  Syatema,  June,  1971,  12,  MS.  No.  458-12 


"Spare  capacity"  measures,  while  Indirect,  offer  a  means  of  evaluating  operator 
loading  in  man-machine  systems  in  the  lass  extreme  range  of  operating  conditions, 
before  overt  errors  occur.  As  such,  they  can  be  useful  in  field  research  in  p  lto- 
motlve  and  aircraft  safety  where  extreme  operating  conditions  any  be  dangerous. 

Spare  capacity  is,  in  most  instances,  determined  by  noting  the  degradation  of 
performance  on  a  subsidiary  task,  while  the  operator  attempts  to  hold  primary  task 
performance  constant,  because  of  the  field  conditions  in  which  most  of  the  studies 
in  this  area  were  performed,  primary  task  analysis  and  subsidiary  task  standardization 
were  often  sacrificed  to  expendlency,  making  the  comparison  of  results  between 
research  studies  and  across  systems  difficult.  Prior  to  choosing  a  standard  spare 
capacity  measure  for  use  in  a  large  scale  automotive  stability  and  handling  project, 
a  variety  of  subsidiary  tasks  utilizing  an  oral  response  mode  were  screened. 

These  included  digit  span,  mental  arithmetic,  self  paced  generation  of  random 
digits,  and  delayed  recall  of  random  digits.  These  measures  were  paired  with  the 
primary  sensorimotor  task  of  vehicle  steering  simulation.  They  were  evaluated  in 
terms  of  their:  interference  with  the  primary  task;  sensitivity  to  primary  task 
loading;  and  convenience  and  ease  of  interpretation. 


W/L  Cat.  Code: 

Op.  Behav.  Code: 
Spare  m.  capacity 
Primary  task 


2.2.1,  3.1 
1.,  3.,  4. 

Subsidiary  task  Experimental 
Single  measures 


Laboratory 


Flight  simulator 
Flight  test 


Zeitlin,  L*  R-  and  Flnkelman.  J.  M.  Subsidiary  task  techniques  of  digit 
generation  and  digit  recall  as  indirect  measures  of  operator  loading. 

Human  Factors,  1975,  12,  218-220. 

As  part  of  an  ongoing  experimental  program,  two  subsidiary  tasks  using  an 
oral  response  mode  were  screened.  They  were  self-paced  generation  of 
random  digits  and  delayed  recall  of  random  digits.  These  measures  were 
paired  with  the  primary  sensorimotor  task  of  "vehicle  steering"  simulation. 

They  were  evaluated  in  terms  of  their  interference  with  the  primary  task, 
sensitivity  to  primary  task  loading,  and  convenience  and  ease  of  Interpretation. 
Although  both  subsidiary  tasks  satisfied  the  fundamental  requirement  that 
they  not  interfere  with  performance  on  the  primary  task,  the  differed 
markedly  in  their  sensitivity  to  the  primary  task  loading.  The  delayed 
digit  recall  subsidiary  task  was  sensitive,  whereas  the  random  digit 
generation  subsidiary  task  was  not. 

W/L  Cat.  Code:  2.2.1,  3.1 

Cp .  Behav .  Code :  1 . ,  2 . „  4 . 

Spare  m.  capacity  Subsidiary  task  Experimental  Laboratory  Flight  simulator 
Primary  task  Single  measures  Flight  test 
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Ziegler,  F.  N .  Single  itnd  dual  axia  Cracking  aa  a  function  of  ayefcam 
dynamics*  Human  Factor*.  3968,  10,  273-276. 

Single  axia  manual  tracking  was  compered  to  dual  axia  tracking  for  aero, 
fir at,  second  and  third  order  dynamic*.  Tracking  error  on  the  original 
a.-*.ia  waa  significantly  degraded  for  flret,  second  nnd  third  order  dynamics 
with  no  difference  occurring  for  rare  ordar.  Th«  reaulta  team  to  Indicate 
that  tha  operator's  information  handling  capacity  becomes  overloaded  aa 
the  ays tar.  order  iucraaaoa  resulting  in  a  decrement  o'  performance. 

W/L  Cat.  Codas  3.1 

Op .  Bahav .  Coda :  1 . ,  2 . ,  4.2 

Primary  task  Single  me^svrr*  Experimental  Laboratory  ‘Flight  simulator 

Flight  teat 


Zicoy,  D.  R. ,  Premaalaar,  S.  J.,  Gargatt,  R.  C. ,  Belyea,  I.  L. ,  and  Hall, 

H.  J.,  dr.  Integrated  information  praasr.tation  and  control  system  study. 
Volume  I  system  development  concepts.  Wright-Pat tfcracn  AFB,  Ohio:  Air 
Fore*  Flight  Dynamics  Laboratory,  Technical  Report  AFFDl-TR-70-79 ,  August, 
1970.  (AD  876  624). 


A  cockpit  concept  for  a  tactical  fighter  aircraft  of  tha  1975-1980  time  period 
vss  developed  to  significantly  reduce  pilot  workload.  Within  the  context  of 
thla  study,  a  composite  mission  profile  and  acanarlo  are  presented  to  define 
the  operational  requi remanta  for  the  system  concept.  Airplane  configuration 
and  performance  are  described,  and  the  charactariatica  and  capabilities  of  the 
on-board  avionica  are  summarised.  A  full-aiied,  single-place  ccckplt  mockup 
and  three  interior  configurations  h.sva  beon  fabricated  to  reflect  study  results 
and  to  serve  aa  evaluation  tools. 


W/L  Cat.  Code;  2.1.1 

Op.  Behav.  Code;  1.,  2.,  3.,  4. 
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Zolina,  Z.  M.  Physiological  criteria  for,  and  definition  of,  physical  and 
mental  stress  at  work.  Proceedings  of  a  Symposium  on  Ergonomics  in 
Machine  Design,  Prague,  Czechoslovakia  and  Geneva,  Switzerland,  1969, 
223-228.  (In  Russian). 


This  paper  gives  a  physiological  definition  of  the  concept  of  heavy  work  and 
occupational  stress.  The  characteristics  of  these  factors  are  evaluated 
objectively  both  at  the  start  of  work,  during  the  steady-state  phase  and 
following  reduction  of  physical  function  capacity  during  the  dey  or  week. 

The  steady— state  phase  is  accompanied  by  higher-nervous  center  stimulation 
and  is  related  to  individual  'dominance'.  The  author  proposes 
that  the  criteria  for  workload  and  work  stress  should  be  based  on  A.  A. 
Ukhtomsky'8  ’principle  of  dominance'  (1950).  The  phase  at  the  start  of  work, 
which  precedes  the  development  of  dominance  over  the  work,  is  a  period  of 
adaptation  to  work  tempo.  This  was  observed  during  the  author's  studies  of 
work  carried  out  at  a  constant  temp  on  a  conveyor  belt.  The  rapid  increase 
in  fatigue  is  manifested  by  a  fall-off  in  dominance  ar.d  pronounced  changes 
in  physiological  f  '•r.lon. 

W/L  Cat.  Code:  4.1, *' 


Op.  Behav.  Code:  4.1,  +.? 

Physiological  Muscle  tension, 
treiuor 


Construct  None  Flight  simulator 

Flight  test 


Zwaga ,  H.  J.  G.  Psychophysiologlcal  reactions  to  Cental  tasks:  Effort  or 
stress?  Ergonomics .  1973,  1.6,  61-67. 

The  implications  of  the  mental  load  model,  used  impllcity  or  explicitly  by 
manv  investigators,  appear  to  be  inconsistent  with  many  experimental  results. 
It  la  c emonstrated  that  a  clearer  picture  emerges  if  the  concept  of  arousal 
is  t  ake  a  into  consideration. 

W/L  Cat.  Code:  4.1.10 

Op.  Behav.  Cole:  1.,  2.,  4. 

Physiological  Heart  rat<=s,  Construct  Laboratory  Flight  simulator 

h.r.  var. 

Experimental  Flight  test 
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Ir  this  section  two  indexing  i.iemes  are  presented,  one  which  groups  the 
documents  by  -workload  technique  and  one  which  groups  them  by  experimental 
facility  used. 

The  workload  technique  index  corresponds  exactly  to  the  "W/L  Cat.  Code" 
numerical  categories  appearing  i«i  each  citation.  In  abstracting  the  documents,  the 
most  general  numerical  rating  was  useu.  For  example,  if  a  document  contained 
information  on  a  Task  Component-Time  Summation  technique  and  an 
Information-Theoretic  technique,  the  category  code  would  be  2.1  instead  of  2.1.1 
and  2.1.2.*  Therefore,  in  using  this  index,  if  a  reader  were  interested  in 
information-theoretic  estimation  techniques,  the  reader  should  look  under  2.1.2 
Information- Theoretic,  2.1  Task  Analytic,  and  2.  Spare  Mental  Capacity. 

The  experimental  facility  index  corresponds  to  the  fourth  column  of  the  word 
descriptors  on  each  abstract.  The  groupings  used  are  Laboratory,  Field,  Simulator, 
Flight  simulator,  and  Flight  teat.  If  no  experimental  facility  was  used,  the 
document  is  not  cited  in  this  section. 

The  groupings  appear  by  author  or  authors  and  date.  If  more  than  one  citation 
has  the  same  authorship  and  date,  lower  case  letters  in  alphabetical  order  follow 
the  dates.  These  letters  correspond  to  the  order  in  which  the  citations  appear  in 
the  annotated  bibliography. 
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Huddleston,  1974 

Huddleston  and  Wilson,  1971 
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Isreul,  Wickens,  Chesney,  and  Donchin,  in  press 
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Isreal,  Wickens,  and  Dcochin,  1979> 

Jenney,  Older,  and  Cameron,  1972 
Jennings  and  Chiles,  1977 
Kahneman,  Beatty,  and  Pollack,  1967 
Kalsbeek  and  Sykes,  1967 
Kantowitz  and  Knight,  1974 
Kantowitz  and  Knight,  1976b 
Kennedy,  1975 

Xornstadt  and  Ffennigstorf,  no  date 
Kraft  and  Elworth,  1969 
Krol,  1971 

Lane  and  Streib,  1977 
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McDonald  and  Ellis,  1975a 
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Proceedings  of  the  ovmpcsium  on  Man-System  Liter  Care,  1976 
Ro.'fe,  157* 

Sanders,  Simmons,  Hofmann,  and  DeBonis,  1977 

Savage,  Wierwilie,  ar.d  Cordes,  1978 

Schiflett,  1989 

Schvaneveldt,  1969 

Shu  In  aii  and  Bviggs,  1971 

Siegel,  Lanterman,  Platze*’,  and  Wolf,  1976 

Soede,  1977 

Spicuzza,  Pinkus,  and  O’Donnell,  1974 

Spyker,  Stackhouse,  Khalafalla,  and  McLans,  1971 

Stackhouse,  1 9‘ '  3 

Stager  and  Muter,  1971 

Stager  and  ZnfxK,  197? 

Steininger  and  Wistufca,  19"T<1 
Stephens  and  Michaels,  1  ?64 
Sternberg,  1969 

Stcrm,  Hartman,  Intaro,  and  Peteis,  19/6 
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Strieb.  1975 
Strother,  1974b 

Thackray.  Joce%  and  Vouchstoac,  1973 

TVig**,  1969 

Tnnabc  and  Noble,  1972 

Trumbo,  Noble,  and  Swink,  1967 

Watson,  1972 

Wempe  and  Baty,  1968 

W'iWc'ricke,  1976 

Whitaker,  1979 

White,  1975 

WhHe  and  Grume,  1975 

Wickeus,  1974 

Wickons,  1976 

Wickens-  1979b 

Wickers  «.nd  Gopher,  1977 

WierwiUe  and  Gutmann,  1978 

Wisrtviila,  Gutmann,  Hicks,  and  Mute,  1977 

Wolfe,  1978 

Zaitzeff,  1969 

Zeitlin  and  Fink  elm  an,  1969a 
Zeitlin  and  Finkeliran,  1569b 
Zeitha  and  Finkelmsn,  1969c 
Zeitlin  and  Fiakelman,  1971 
Zeitlin  and  Finkelman,  1975 


r 
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AUuisi  and  Morgan,  1971 
fienel,  Coles,  and  fienel,  1 979 
Bergeron,  1968 

Bloszczynski  and  Kszerenko,  1977 
Corkindale,  1974 
Damos  and  Wickens,  1977a 
D&tnos  and  Wickens,  1977b 
Faulkn  v  and  Onstott,  1977 
Glenn,  Streib,  and  Wherry,  197? 

Gopher  and  Navon,  1978 

Gopher  and  Navon,  1 979 

Gopher,  Navon,  Chillag,  and  Dot, in,  1977 

Hall,  Passey,  and  Meighan,  1965 

Hari'is,  North,  and  Owens,  1977 

Hart  and  McPherson,  1976 

Herman,  1965 

Hicks  and  Soliday,  1972 

Jex,  1967 

Johannsen,  Pfendler,  and  Stein,  2976 
Kantowitz  and  Knight,  1974 
Kantowitz  and  Knight,  1976b 
Kantowitz  and  Knight,  1977 
Lane,  1977 

Lane  and  Streib,  1 977 
Levison,  1970 
Michon,  1964 
Michon,  1966 
Michon  and  Doorne,  1967 
Navon  and  Gopher,  1979 
North,  1977 

North  and  Gopher,  1977 
O’Donnell  and  Spicuzza,  1975 
Onstott  and  Faulkner,  1 977 
Pfendler  and  Johannsen,  1977 
Shultnan  and  Briggs,  1971 
Stephens  and  Michaels,  1964 
Strieb,  1975 

Trurnbo  and  Noble,  1972 
Wewerinke,  1976 
Wickens,  1974 
Wickens,  1976 


Wickens,  Isreal,  McCarthy,  Gopher,  and  Done! 
Wickens  and  Keasel,  1977  w 

Wickens  and  Tsang,  1979 
Wickens,  Tsang,  and  Benel,  1979 
Wildervanck,  Mulder,  and  Michon,  1978 


1976 


vrr 

^  ’■WflllJiw  wmt-.jw.uv  ....  ... 


'.-'i.'iJj-T  t '.  1 1-7 


SY-27R-80 


2.2.3  Time  Estimation 


Hart,  1975 
Hart,  1976 
Hart,  1979 

Hart  and  McPherson,  1976 

Hart,  McPherson,  Kreifeldt,  and  Werape,  1977 

Hart,  McPherson,  and  Loomis,  1978 

Hart  and  Simpson,  1976 

Hartzell,  i9?9 

Hopkin  and  Napier,  1963 

Jennings  and  Chiles,  1977 

Madero,  Sixton,  Gunning,  and  Moss,  1979 

McCauley,  Kennedy,  and  Bittner,  1979 

McGrath,  1969 

NASA- Ames  Research  Center,  1975 
Phillips,  1976 

Proceedings  of  the  Symposium  on  Man-System  Interface,  1978 
Simpson  and  Hart,  1977 
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Z.?.*  Adaptive,  Arithmetic/Logic 


Brecht,  1977 

Dunn,  Gilson,  and  Sun,  1976 

Enstrom  and  Rouse,  1976 

Eustroo  and  Rouse,  1977 

Gil&on,  Burke,  and  Jagacinski,  1978 

Gopher  and  North,  1977 

Jones  and  Schuster,  1970 

Kelley,  1966 

Kelley  and  War  go,  1S'67 

Krause  and  Roscoe,  1972 

Merh&v  and  Ya'acov,  1976 

Roscoe,  1974 

Schorl,  1973 

Schori  and  Jones,  1975 

Stackhouse,  1976 

Sun,  Keane,  and  Stackhouse,  1976 
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Burke,  1979 

Clement,  McRuer,  and  Klein,  no  date 
Ephrath,  1976 

Gilson,  Burke,  and  Jagacinski,  1978 
Gopher,  Navon,  and  Chillag,  1977 
Hess  and  Teichgrabar,  1974 
Jex,  1979 

Jex  and  Allen,  1970a 

Jex,  Jewell,  and  Allen,  1972 

Jex,  McDonnell,  and  Phatak,  1966 

Kelley,  1966 

Kelley  and  War  go,  1967 

McFeely,  1972 

Schori,  1973 

Schori  and  Jones,  1975 

Spicuzza,  Pinkus,  and  O'Donnell,  1974 

Stackhouse,  1976 

Sun,  Keane,  and  Stackhouse,  1976 

Teichgraber,  1972 

Westbrook,  Anderson,  and  Pietrzak,  1966 
Whitaker,  1979 
Wickens  and  Tsang,  1979 
Wickens,  Tsang,  and  Benel,  1979 
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Bate  and  Se)£>  1968 
Far  her  end  Gallagher,  1972 
|  Glenn,  Streib,  and  Wherry,  1977 

;  Hicks  and  Wierwille,  1973 

j  Sendees,  Kristofferaon.  Leviscn,  Dietrich,  and  Ward,  1967 
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3.  Primary  Task 


Butterbaugh,  1978 
Chiles,  1977 
Chiles,  1978 
Chiles  and  Alluisi,  1978 
Gartner  and  Murphy,  1976 
Gartner  and  Murphy,  1979 
Geer,  1977  a 
Geer,  1977b 
Gerathewohl,  1976 
Gunning,  1978 
Hacker,  1974 

Hartman  and  McKenzie,  1979 

Hopkin,  1979 

Jahns,  1973a 

Janns,  1973b 

Johannsen,  1979 

Kikolov,  1978 

Lauschner,  1969 

Leplat,  1973 

Machac,  1971 

Reising,  1972 

F.chmert,  1971 

Roi-coe,  197Sa 

Sanders,  1979 

Schiflett,  1976 

Schnuten,  Kalsbee  k,  and  Leopold,  1962 
Soede,  1979 
Stackhouse,  1973 

Stress  in  Air  Traffic  Control  Research  Association,  1971 

Szekely,  1975 

Wickens,  19/9a 

Wierwille  and  Williges,  1978 

Wierwille,  Williges,  and  Schiflett,  1979 

Williges  and  Wierwille,  1979 
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Adams  and  Rich,  2  977 
Akhutin,  1977 
Albaneae,  1977 
Aibaneoe,  1979 

Allan,  Jex,  McRuer,  and  DiMarco,  1975 

Af}P?H'  i^,tonis»  and  Reynolds,  1 97Z 
Alluist  and  Morgan,  1969 

Aliuisi  ai:d  Morgan,  1971 

Anderson  and  Toivanen,  1970 

Asset,  Batejat,  Papin,  and  Viard,  1976 

Bambridge,  1978 

Bate  and  Self,  1968 

Bateman,  1979 

Baty,  1971 

Bell,  1973 

Benel,  Coles,  and  Benel,  I979 
Bergeron,  1968 

Sergstroem  and  Ambers,  3971 
Beringer,  1979 
Bermudez,  1 979 
Beyer,  1 977 

BW,  Gcdthelp,  and  Morall,  1977 
Blowczynski  and  Kozerenko,  1977 
Boiler  and  Kruger,  1 978 
Bradshaw,  1968 
Brauscornb,  1979 
Brecht,  1977 

Brenner,  Branscomb,  and  Schwartz,  1979 

Brichcm  and  H&mpejsova,  1970 

Br  ictson,  1974a 

Brictson,  1974b 

Bromberger,  1976 

Brown,  1965 

Brown,  1966 

Buckley  and  O’Connor,  1979 
Burke,  1 973 
Burke,  1977 
Burke,  1979 

Ss^'  Na““' 1777 

Cavalli,  1977 

•“* wo 

Chiles  and  Aliuisi,  197  9 

Chiles,  Jennings,  and  Aliuisi,  1079 

Clement,  1978 

Cliff,  1971 

Crawford,  1979 


Single  Measure# 
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Curry,  1979 

Curry,  Kleinman,  and  Hoffman,  1977 
Damos  and  Wickens,  1977a 
Damos  and  Wickens,  1977b 
Danev,  Radneva,  and  Zlatarov,  1975 
Daniels,  1970 

Dick,  Brown,  and  Bailey,  1976 
Dougherty,  Emery,  and  Curtin,  1964 
Dunn,  Gilson,  and  Sun,  1976 
Edwards,  Pilette,  and  Biggs,  1978 
Enstrom  and  Rouse,  1977 
Ephrath,  1976 
Ephrath,  1977 
Ettema  and  Zielhuis,  1971 
Fergenson  and  Gold,  1977 
Finkelman  and  Glass,  1970 
Flora,  Kriechbaum,  and  Willich,  1969 
Frankenhaeuser  and  Johansson,  1976 
Frolov,  1976 

Gale,  Davies,  and  Smallbone,  1977 
Gerathewohl,  Chiles,  and  Thackeray,  1976 
Gilson,  Burke,  and  Jagacinski,  1978 
Goldstein,  Dorfman,  and  Price,  1978 
Gopher  and  Navon,  1978 
Gopher  and  Navon,  1979 
Gopher,  Navon,  and  Chillag,  1971 
Gopher,  Navon,  Chillag,  and  Dotan,  1977 
Gopher  and  North,  1977 
Green  and  Flux,  1977 
Gunning,  1978 

Guttman,  Easterling,  and  Webster,  1972 
Hacker  et  al.,  1977 

Hacker,  Plath,  Richter,  and  Zimmer,  1978 
Hagen,  Moe,  and  Woratschek,  1978 
Harris,  North,  and  Owens,  1977 
Hart,  McPherson,  Kreifeldt,  and  Wempe,  1977 
Hartzell,  1979 

Hawkin Church,  and  de  Lemos,  1978 
Hawkins,  Rodriguez,  and  Reicher,  19V9 
Helander,  1975 
Helm,  1976 

Henry,  Davis,  Engelken,  Triebwasser,  and  Lancaster,  1974 
Herman,  1965 

Hess  and  Teichgraber,  1974 
Hickok,  1973 
Hilgendorf,  1967 
Hoffman  and  Joubert,  1966 
Holland  and  Tarlow,  1972 
Hopkin  and  Napier,  1963 
Howells,  Knight,  and  Weiss,  1979 
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Huddle  a  ton,  1974 
Huddleston  and  Wilson,  1971 
Ikust  and  Rose,  1978s 
Hurst  and  Rose,  1978b 
Ioseliani,  1971 

Isreal,  Wickens,  Chesney,  and  bonchin,  in  press 
Isreai,  Wickens,  and  Donchin,  1979 
Ivanov-Muromskii  and  Lukianova,  1975 
Jennings  and  Chile*,  1977 
Jex,  1967 

Jex,  Jewell,  and  Allen,  1972 

Johannsen,  1976 

Johnston,  Klein,  and  Hoh,  1976 

Joslin,  Ohratya,  and  Ellis,  1977 

Kahneman,  1973 

Kalsbeek  and  Sykes,  1967 

Kantowitz  and  Knight,  1974 

Kantowitz  and  Knight,  1976a 

Kantowitz  and  Knight,  1976b 

Kantowitz  and  Knight,  1977 

Kantowitz  and  Knight,  1978 

Kelley  and  Wargo,  1967 

Kennedj',  1975 

Kennedy,  1978 

Klein  and  Cassidy,  1972 

Klein  and  Hall,  1975 

Klotzbucher  and  Roloff,  1977 

Kopala,  1979 

Krause  and  Roscoe,  1972 

Krebs  and  Wingert,  1976 

Krebs,  Wingert,  and  Cunningham,  1977 

l'reifeldt,  Parkin,  and  Rothschilo,  1976 

Krol,  1971 

Krzanowski  and  Nicholson,  1972 

Laurell  and  Lispar,  1978 

Lebacqz  and  Aiken,  1975 

Logan,  1979 

Lovesey,  1977 

Luczak  and  Rohmert,  1976 

Madero,  Sixton,  Gunning,  and  Moss,  1V?9 

Mashhour,  1969 

McCauley,  Kennedy,  and  Bittner,  1979 
McDonald  and  Ellis,  1975a 
McDonald  and  Ellis,  1975b 
McFeely,  1972 
McGrath,  1969 
McKenzie,  1979 

McKenzie,  Buckley,  and  Sarlanis,  1979 
McLean  and  Hofimann,  1975 
Melton,  1979 

Merhav  and  Ya'acov,  1976 
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Milord  and  Perry,  1977 
Monty  and  Rubin,  1965 
Moray,  1976 

Morgan,  Coates,  Alluisi,  and  Kirby,  1978 

Morrissette,  Crannell,  and  Switzer,  1965 

Murphy,  McGee,  Palmer,  Paulk,  and  Wempe,  1974 

Nataupsky,  Schwank,  Griggs,  McKay,  and  Schmidt,  1979 

Navon  and  Gopher,  1979 

Noel,  1974 

Norman,  1975 

North  and  Gopher,  1977 

Och,  no  date 

O'Donnell,  1975 

O’Donnell,  1976 

Offenlock,  1977 

Older  and  Jenney,  1975 

Olson,  1966 

Onstott,  1976 

Owens  anu  Harris,  1978 

Pardon,  1 97 

Pasmocij,  1975 

Payne  and  Buck,  1979 

Pfendler  and  Jc'iannsen,  1977 

Price,  1971 

Proceedings  of  the  Symposium  on  Man-System  Interface,  1978 

Replogle,  Holden,  Gold,  Kulak,  Jonas,  and  Potor,  1971 

Roediger,  Knight,  and  Kantowitz,  1977 

Rohmert,  1979 

Ro'.fe,  1971 

Rolfe,  197o 

r’  olfe  and  Lindsay,  1973 
os  oe,  1978c 
Roscoe,  1979 
Roscoe,  1  974 
Roiondo,  1978 
Reuse,  1979 
Schick,  1976 

Schiffler,  Geiselhart,  and  Griffin,  1978 

Schiflett  and  Loikith,  1979 

Schori,  1973 

Schvan  veldt,  1969 

Seibel,  Christ,  and  Teichner,  1964 

Sebej  and  Biro,  1978 

Sherman,  1973 

Shiffrin  end  Gardrer,  197?. 

Shulman  and  Briggs,  1971 
Siegel  and  Williams,  1974 
Siegel,  Wolf,  and  Sorer.con,  1962 
Simmons,  Lees,  and  Kimball,  1978a 
Simmons,  Sanders,  and  Kimball,  1979 
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Smit,  1976 
Smith,  1979 
Smith,  1972 
Soede,  1977 
Spady,  1978 
Sperandio,  1971 
Sperandio,  1978 

Spyker,  Stackhouse,  Khalafalla,  and  McLane,  1971 
Steininger  and  Wistuba,  1974 
Sternberg,  1969 

Stone,  Sanders,  Glick,  Wiley,  and  Kimball,  1979 
Strasser,  1974 
Strasser,  1977 

Strasser,  Brilling,  Klinger,  and  Mueller -Limmroth,  1973 

St)  .her,  1974a 

Strother,  1974b 

Sunder  meyer  and  Alles,  1979 

Sverko,  1977 

Teichgraber,  1972 

Thackray,  Jones,  and  Touchstone,  1973 
Tomashevskaya,  1974 
Trumbc,  Noble,  and  Swink,  1967 
Vei  plank,  1976 

Waller,  Harris,  and  Salmirs,  1979 
Wanner,  1978 
Welford,  1978 
Wempe  and  Baty,  1968 
Whitaker,  1979 
White  and  Ware,  1969 
Wickens,  1979b 
Wickens  and  Gopher,  1977 
Wickens,  Isreaij  and  Donchin,  1977 
Wickens  and  Kessel,  1977 
Wickens  and  Kessel,  1979 
iVickens  and  Pierce,  1977 
Wickens  and  Tsang,  1979 
Wickens,  Tsang,  and  Benel,  1979 
Wiener,  1977 

Wierwille,  Gutmann,  Hicks,  and  to,  1977 
Zaitzeff,  1969 

Zeitlin  and  Finkelman,  1969a 
Zeitlin  and  Finkelman,  1969b 
Zeitlin  and  Finkelman,  1969c 
Zeitlin  and  Finkelman,  1971 
Zeitlin  and  Finkelman,  1975 
Ziegler,  1968 
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3.2  Multiple  Measures 


Armstrong,  Sams,  McDowell,  and  Winter,  1975 
Bateman,  1979 
Brictson,  1977 

Brictson  and  CiavArelli,  i9?9 
Chiles  and  Alluisi,  1979 
Clark  and  Armstrong,  1977 
Clement,  1976 

Control-display  pilot  factors  program,  1963 

Crabtree,  1975 

Cross  and  Cavallero,  no  date 

Danev  and  Wartua,  1970 

Fowler,  Williams,  Fcwler,  and  Young,  1968 

Frolov,  1976 

Gerathewohl,  Chiles,  and  Thackeray,  1976 
Hall,  Passey,  and  Meighan,  1965 
Helm,  1978 

Hicks  and  Wierwille,  1979 
Jex  and  Allen,  1970a 
Kerr,  1973 

North  and  Graffunder,  1979 
O'Donnell  and  Spicuzza,  1975 
Potempa,  1969 
Repa  and  Wierwille,  1976 
Repko,  Loeb,  and  Brown,  1974 

Rolfe,  Chappelow,  Evans,  Lindsay,  and  Browning,  1974 
Sanders,  Burden,  Simmons,  Lees,  and  Kimball,  1978 
Simmons  and  Kimball,  1977 
Soliday,  1965 

Soliday  and  Schohan,  1965 
Stackhouse,  1976 
Sun,  Keane,  and  Stackhouse,  1976 
Waugh,  1975 

Wierwille  and  Gutmann,  1978 
Wildervarck.  Mulder,  and  Michon,  1978 
Wolfe,  1978 
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3. 3  Math  Modeling 


Albansse,  19V  7 
Albanese,  1979 
Aijitilfl,  1975 
Baron  and  Leviaon,  197') 

Baron.  Muraiidharan,  and  Kleinman,  1978 
Cavalii,  1977 

Chiles,  Jennings,  and  Alluiai,  1979 
Cbu  and  Rouse,  1977 
Clement,  1978 

Clement,  Hofmann,  and  Graham,  1973 
Clement,  Jex,  and  Graham,  1968a 
Clement,  Jex  and  Graham,  1968b 
Clement,  McRuer,  and  Klein,  no  date 
Curry,  1979 

Curry,  Kleinman,  and  Hoffman,  1977 
Enstrom  and  Rouse,  1976 
Enstrom  and  Rouse,  1977 
Ephrath,  1976 
Faulkner  amd  Onstott,  1977 
Glenn,  Streib,  and  Wherry,  1977 
Hacker  et  al.,  1977 
Hat&ell,  1977 

Holden,  Rogers,  and  Replogle,  1974 
Jex,  1979 

Jex  and  Allen,  1970a 

Jex,  McDonnell,  and  Phatak,  1966 

Johnston,  Klein,  and  Hoh,  1976 

Kirchner  and  Laurig,  1971 

Kleinman  and  Curry,  1976 

Levison,  1970 

Levison,  1979 

Luc*ak,  1 97 1 

Moray,  1976 

Moray,  1979 

Mulder,  1979a 

Murphy,  1978 

Navon  and  Gopher,  1977 

Onstott,  1976 

Onstott  and  Faulkner,  1977 
Phatak,  1973 

Proceedings  of  the  Symposium  on  Mar-System  Interlace,  1978 
Rasmussen,  1979 
Rault,  1976 
Rault,  1979 

Ringland  and  Craig,  1?77 
Rolfe  and  Lindsay,  1973 
Rouse,  1977 
Rouse,  1979 
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4.  Physiological  Measure* 


Butterbaugh,  1978 
Gartner  and  Murphy,  1976 
Gartner  and  Murphy,  1979 
Geer,  1977  a 
Geer,  1977b 
Gerathewohl,  1976 
Hacker,  1974 

Hartman  and  McKenzie,  1979 

Hopkin,  1979 

Jahns,  1973a 

Jahns,  1973b 

Je*  and  Clement,  1979 

Johannsen,  1979 

Kikolov,  1978 

Lauschner,  1969 

Leplat,  1978 

Machac,  1971 

Reising,  1972 

Ro.hmert,  1971 

Roscoe,  1978a 

Roscoe,  1978b 

Sanders,  1979 

Schiflett,  1976 

Schouten,  Kalsbeek,  and  Leopold,  1962 
Soede,  1979 

Stress  in  Air  Traffic  Control  Research  Association,  1971 

Szekely,  1975 

Teiger,  1978 

Ursin  and  Ursin,  1979 

Wickens,  1979a 

WierwiUe,  1979 

Wierwille  and  Williges,  1978 

WierwiUe,  Williges,  and  Schiflett,  1979 
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4.1  Single  Physiological  Measures 


Auffret,  1977 
Crawford,  1979 
Hacker  et  al.f  1977 
Helander,  1975 

Ivanov-Muromskii  and  Lukianova,  1975 

Kennedy,  1970 

Leplat  and  Pailhous,  1973 

McKenzie,  1979 

Morgan,  1975 

Mulder,  1979a 

Murphy,  1980 

Rolfe,  1976 

Rolfe  and  Lindsay,  1973 
Rouse,  1979 
Stnit,  1976 

Smit  and  Wewerinke,  1978 
Stackhouse,  1978 
Strasser,  1979 

Wildervanck,  Mulder,  and  Michon,  1978 
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4.1.1  YFF 

Baschera  and  Grandjean<  1979 
Guttaaann,  Easterling,  and  Webster,  1972 
Jenney,  Older,  and  Canaeror.,  1972 
Lisper,  Laurell,  and  Stening,  1973 
Schick,  1976 
Voile,  1978 
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4.1.2  GSR 


Benel,  Coles,  and  Bene,,  1979 

Benson,  Huddleston,  and  Rolfe,  1965 

Buckley  and  O'Conner,  1979 

Chainova,  Komarova,  and  Zouabend,  19*'0 

Cohen  and  Silverman,  1957 

Gaume  and  White,  1975 

Jex  and  Allen,  197  Gb 

Kahneman,  Tursky,  Shapiro,  and  Crider,  1969 
Lorens  and  D arrow,  1 962 
McKenzie,  Buckley,  and  Sai*lanis,  1979 
Noyer,  1971 

Spyker,  Stackhouse,  Khalafsilla,  and  McLane,  1971 
Wes.'brook,  Anderson,  and  Pietrzak,  1966 
White  and  Gaume,  1975 
Zeier,  1979 


SY-27R-S0 


4,1.3  EKG 

Akhutin,  1977 
Bo  yea,  1974 
Graham,  1977 

Howitt,  Hay,  Shergoid,  and  Ferres,  1978 
Jex  and  Alien,  1970b 

Kundiev,  Navakatikian,  Tomashovskaia,  DerKach,  and  Kovaleva,  1976 

Laurlg  and  Phillip,  1970 

Markiewicz,  Koradicka,  and  Konarska,  1977 

Melton,  Smith,  McKenzie,  Wicks,  and  Silver,  1  V?7 

Mobbs,  David,  and  Thomas,  1971 

Mulder,  1979b 

Mulder  and  Mulder-Hajonides  van  der  Meulen,  1973 
Negoescu,  1979 

Nicholson,  Hill,  Borland,  and  Krzanowski,  1973 
North  and  Graffunder,  1979 
Opmeer,  1973 

Pasmooij,  Opmoer,  and  Hyndman,  1976 

Rault,  1976 

Rohmert,  1977 

Rohmert,  1979 

Roscoe,  1978c 

Roscoe,  1979 

Rosen  brock,  1971 

Sch  warz  and  Ekkers,  1976 

Sekiguchi,  Handa,  Got  oh.  Kurihara,  Nagasawa,  and  Kuroda,  1978 

Sem-Jacobten,  1976 

Simonov,  Frolov,  and  Sviridov,  1975 

Soede,  1977 

Soutendam,  1977 

Spyker,  Stackhouse,  Khalafalla,  and  McLane,  1971 

Stackhouse,  1973 

Stackhouse,  1  <>76 

Sun,  Keane,  and  Stackhouse,  19’’ 6 

White  and  Ganme,  1975 

Wisner,  1973 

Wolf,  19ll 

Wolfe,  1978 

Zeier,  1979 
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4.1.4  EMG 


Benson,  Huddleston,  and  Rolfo,  1965 

Cahinova,  Komarova,  and  Zanabend,  1970 

Jex  and  Allen,  1970b 

Luczak  and  Rohmert,  1976 

North  and  Graf  funder,  1979 

Rault,  1976 

Rault,  1979 

Rohmert,  1979 

Rosenbrock,  1971 

Sherman,  1973 

Spyker,  Stackhouse,  Khalafalla,  and  Me  Lane.,  1971 

Stackhouse,  1976 

Sun,  Keane,  and  Stackhouse.  1976 

Westbrook,  Anderson,  and  Pietrzak,  1966 

Wisner,  1973 

Wolf,  1977 

Wolfe,  1978 

Zaier,  1979 


\ 
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Akbutin,  '977 

Chainova,  Komarova,  and  Zonabend,  1970 
Cohen  and  Silverman,  1957 
Defayolle,  Dinand,  and  Gentil,  1973 
Elkin,  1971 

Gale,  Davies,  and  Smallbone,  1977 
Gotner,  Be  idem  an,  and  Levine,  1979 
Harris,  Peg  ram,  and  Hartman,  1971 
Howitt,  Hay,  Shergcld,  and  Ferres,  1978 
Lawrence,  1979 
Lorens  and  Darrow,  1962 
Negoescu,  1979 
Offenlock,  1977 

Proceedings  of  the  Symposium  on  Man-System  Interface,  1978 
Rash  man,  1972 
Rohmert,  1977 
Rosenbrock,  1971 

Spyker,  Stackhouse,  Khalafalla,  and  McLane,  1971 
Wisner,  1973 


Defayolle,  Dinand,  and  Gentil,  1973 
Gome',  Beideman,  and  Levine,  1979 
Isreal,  Chesnevr  WicKens,  and  Donchin,  in  press 
Isreal,  Wickens,  Chesney,  and  Donchin,  in  press 
Isreal,  Wickens,  and  Donchin,  1979 
Lawrence,  1979 

Proceedings  of  the  Symposium  on  Man-System  Interface,  1978 
Soede,  1977 
Soutendam,  1977 

Strasser,  Brilliog,  Klinger,  and  Mueller-Limmroth,  1973 
Wickens,  Isreal,  and  Donchin,  1977 
Wickens,  Isreal,  McCarthy,  Gopher,  and  Donchin,  1976 
Wisner,  1973 
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4.1.7  Eye  and  Eyelid  Movement 


Alien,  Jei.,  McRuer,  and  Di Marco,  1975 

Anderson  •'usd  Chiou,  1977 

Asi,  la,  1975 

Barnes,  1977 

Burke,  1973 

Burke,  1977 

Casey?  Breitmaier,  and  Nason,  1977 
Cavalli,  1977 
Ceder,  1977 

Chainova,  Komarova,  and  Zonabend,  1970 
Clement,  1976 
Clement,  1978 

Clement,  McRuer,  and  Klein,  no  date 
Corkindale,  1974 
Dick  and  Bailey,  1976 
Dick,  Brown,  and  Bailey,  1976 

Gerathewohl,  Brcwn,  Burke,  Kimball,  Lowe,  and  Stackhouse,  1978 

Gomer,  Be’demrn,  and  Levine,  1979 

Gopher,  1973 

Graham,  1977 

Harris  and  Mixon,  1979 

Hayrshi  and  Ogawara,  1977 

Holland  and  Tar  low,  1972 

Kennedy,  1978 

Krebs  and  Wingert,  1976 

Krebs,  Wingert,  and  Cunningham,  1977 

Lorens  and  Darrow,  1962 

Luczak  and  Rohmert,  1976 

Mourant  and  Rockwell,  1970 

North  and  Graffunder,  1979 

Rault,  1976 

Rault,  1979 

Sanders,  Simmons,  and  Hofmann,  1979 

Sanders,  Simmons,  Hofmann?  and  DeBanis,  1977 

Sherman,  1973 

Simmons,  1979 

Simmons  and  Kimball,  1977 

Simmons  and  Kimball,  1979 

Simmons,  Kimball,  and  Diaz,  1976 

Simmons,  Lees,  and  Kimball,  1978a 

Simmons,  Lees,  and  Kimball,  197 8h 

Simmons,  Sanders,  and  Kimball,  1979 

Spady, 1977 

Spady,  1978 

Spicuzza,  Pinkus,  am  ill,  1974 

Strother,  1974a 
Strother,  1974b 
Waller,  1976 
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Waller,  Harrk,  and  Saits  in,  1979 

Weir  and  Klein,  1«>70 

Wianer,  1973 

Wolf,  1977 

Wolfe,  1978 


lW*3*  ?,fTI7  1 
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»  4.1.8  PufeUlary;  Dilation 

t 

I  Anderson  and  Chiou,  1 977 

;  Beatty,  1976 

[  Beatty,  1979 

f  Bradshaw,  1968 

I  Gardner,  Beltramo,  and  Kriasky,  1975 

I  Graham,  1977 

['  Harris  and  Mbcon,  1979 

Juris  and  Velden,  1977 
Kahneman,  Beatty,  and  Pollack,  1967 
Kahneman,  Tursky,  Shapiro,  and  Crider,  1969 
Krebs  and  Wingert,  1976 
Krebs,  Wingert,  and  Cunningham,  1977 
McFeely,  1972 
!i'  Noel,  1974 

North  and  Graff  under  ,  1979 

Proceedings  of  the  Symposium  on  Man-System  Interface,  1978 
|  Sherman,  1973 

i  Sint ",  >,  1967 

f  Westbrook,  Anderson,  and  Pietrzak,  1966 

I  Wolfe,  1978 
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4.1.9  Muscle  Tension,  TWmor 


I 

I 

I 

l 

I 

l 

I 


Benton,  Huddleston,  and  Rolfe,  196$ 

Clement,  McRuer,  and  Klein,  no  date 

Graham,  1977 

Hickok,  1973 

Jex  and  Allen,  1970b 

Laville,  Teiger,  and  Duraffourg,  1972 

Luczak  and  Rohmert,  1976 

Markiewicz,  Koradicka,  and  Konarska,  1977 

Nakamura,  Okaue,  and  Hori,  1974 

Nicholson,  Hill,  Borland,  and  Krzanowski,  1973 

North  and  Giaffunder,  1979 

Rault,  1976 

Rohmert,  1979 

Sherman,  1973 

Smith,  1972 

Zeier,  1979 

Zolina,  1969 
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4.1.10  Heart  Rate,  Heart  Rate 
Variability,  Blood  Pressure 

Akhutin,  1977 

Auffret,  Seris,  Berthoz,  and  Fatras,  1967 

Baschera  and  Grandjean,  1979 

Benson,  Huddleston,  and  Rolfe,  1965 

Bergstroem  and  Arnberg,  1971 

Blyx,  1974 

Boyce,  1974 

Brecht,  1977 

Buckley  and  O'Conner,  1979 

Caplan  and  Jones,  1975 

Cha inova,  Komarova,  and  Zonabend,  1970 

Clark  and  Armstrong,  1977 

Corlett,  1973 

Danev,  Radneva,  and  Zlatarov,  1975 
Ettema,  1969 
Ettema  and  Zielhuis,  1971 
Firth,  1973 

Frankenhaeuser  and  Johansson,  1976 
Fujihara,  Sakurai,  and  Kakimoto,  1978 
Gaume  and  White,  1975 
Goeters,  1975 
Hicks  and  Soliday,  1972 
Hicks  and  Wierwille,  1979 
Hyndman  and  Gregory,  1975 
Inomato,  1977 

Jenney,  Older,  and  Cameron,  1972 
Jex  and  Allen,  1970b 

Kahn eman,  Tursky,  Shapiro,  and  Crider,  1969 

Kalsbeek,  1968 

Kalsbeek,  1969 

Kalsbeek,  1973a 

Kalsbeek,  1973b 

Kalsbeek  and  Sykes,  1967 

Klotzbucher  and  Roloff,  1977 

Krivohlavy,  1968a 

Krivohlavy,  1968b 

Kundiev,  Navakatikian,  Tomashevskaia,  Derkach,  and  Kovaleva,  1976 

Laurig  and  PhiUip,  1970 

Lisper,  Laurel],  and  Stening,  1973 

Lorens  and  Darrow,  1 962 

Luczak  and  Laurig,  1973 

Luczak  and  Rohmert,  1976 

McKevute,  Buckley,  and  Sarlanis,  1979 

Melton,  Smith,  McKenzie,  Hoffmann,  and  Saldivar,  1976 

Melton,  Sniit’t,  McKanzie,  Wicks,  and  Silver,  1977 

Mobbs,  Dovid,  end  Thomas,  1971 

Mulder,  1579b 

Mul.tu*  and  Mold  ei-Haj  on  ides  van  der  Meulen,  1973 
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Nakamura,  Okaue,  and  Hori,  1974 

Negoescu,  1979 

North  and  Graffunder,  1979 

Ohhara,  1970 

Opmeer,  1973 

Opmeer  and  Krol,  1 973 

Pasmooij,  1975 

Pasinoofl,  Opmeer,  and  Hyndman,  1976 

R  ashman,  1972 

Rault,  1976 

Rohmert,  1977 

Rohmert,  1979 

Rohmert,  Laurig,  Philipp,  and  Luczak,  1973 

Roscoe,  1975 

Roscoe,  1976a 

Roscoe,  1976b 

Roscoe,  1978c 

Roscoe,  1979 

Roscoe  and  Goodman,  1973 
Sayers,  1973 

Sekiguchi,  Haiida,  Gotob,  Kurihara,  Nagasawe,  and  Kuroda,  1978 
Sem- Jacobsen,  1976 
Sherman,  1973 

Simonov,  Frolov,  and  Sviridov,  1975 
Smith,  1979 
Soede,  1977 

Spyker,  Stackhouse-  Khalafalla,  and  McLane,  1971 
Stackhouse,  1973 
Strawcr,  1974 
Straner,  1977 

Strasser,  Brilling,  Klinger,  and  Mueller-Lim mrol  h,  1973 

Tom  as  he  vsh  ay  a,  1974 

Vettes,  1977 

White  and  Gaume,  1975 

Wisner,  1973 

Wolfe,  1978 

Zeier,  1979 

Zwaga,  1973 
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4.1.11  Breathing  Analysis 

Benton,  Huddleston,  and  Rolfe,  1965 

Kttema  and  Zielhuis,  1971 

Gaume  and  White,  1975 

Graham,  1977 

Jex  and  Allen,  1970b 

Klotzbucher  and  Roioff,  1977 

Krivohlavy,  1968a 

Mobbs,  David,  and  Thomas,  1971 

Mulder,  1979b 

Mulder  and  Mulder- Hajcnides  van  der  Meuleu,  1973 
Ohhara,  1970 
Opmeer  and  Krol,  1973 
Pasmootj,  1975 

Pettyjohn,  McNeil,  Akers,  and  Faber,  1977a 
Pettyjohn,  McNeil,  Akers,  and  Faber,  1977b 
Ra&hman,  1972 
Rault,  1976 

Rosen  brock,  1971 

Sayers,  1973 
Sebej  and  Biro,  1978 

Spyker,  Stackhouse,  Khalafalla,  and  Me  Lane,  1971 

Stackhouse,  1976 

Sun,  Keane,  and  Stackhouse,  1976 

White  and  Gaume,  1975 

Wolf,  1977 

Wolfe,  1978 


I 
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44.12  Body  Fluid  Analyte 


Clark  and  Armstrong,  1977 

Clark,  Arnold,  Foulds,  Brown,  East  mead,  and  Parry,  1975 

Frankenhaeuser  and  Johansson,  1976 

Hale,  Anderson,  Williams,  and  Tanne,  1968 

Hale,  Hartman,  Harris,  William^  Miranda,  and  Hosenfeld,  1972 

Hale,  Hartman,  Harris,  Williams,  Miranda,  Hosenfeld,  and  Smith,  1971 

Hale,  Hartman,  Harris,  Williams,  Miranda,  Hosenfeld,  and  Smith,  1972 

Hale,  McNee,  Ellis,  Bollinger,  and  Hartman,  unpublished 

Hale,  Williams,  Smith,  and  Melton,  1971 

Hartman,  Hale,  and  Johnson,  1974 

Hutcherson,  1971 

Klotxbucher  and  Roloff,  1977 

KrahenbuM,  Marett,  and  King,  1977 

Kundiev,  Nav&katikian,  Tomashevskaia,  Derkach,  and  Kovaleva,  1976 
Linn,  1972 
Melton,  1979 

Melton,  Smith,  McKensie,  Hoffmann,  and  Saldivar,  1976 

Melton,  Smith,  McKenzie,  Wicks,  and  Silver,  1977 

Miller,  Rubin,  1970 

Rohmert,  1979 

Soutendam,  1977 

Storm  and  Hapenney,  1976 

Storm,  Hartman,  Intano,  and  Peters,  1976 

’Street,  Singh,  and  Hale,  1970 

Tomashevskaya,  1974 

Williams,  1971 


Kalcbeekt  1968  '  v  4,1,13  jj^wrttfag 

Kalnbeek,  19?3b 
Kalab««k  and  Syke«,  1967 
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4.2  Combined  Physiological  Mmart; 


Brictson,  1977 

Brictsoc,  McHugh,  and  Naitoh,  1974 
Danev  and  Wartna,  1970 
Frolov,  1976 

Gerathewohl,  Brown,  Burke,  Kimball,  Lowe,  *n£  Stackhouse,  1973 
Graham,  1977 

Hale,  McNee,  EUis,  Bollingei,  and  Hartman,  1974 

Krxanowski  and  Nicholson,  1972 

McHugh,  Brictson,  and  Naitoh,  1974 

North  and  Graf  funder,  1979 

Rolfe,  1973a 

Simracm,  1968 

Stackhouse,  1978 

Wolfe,  1978 


4.3  8p— ch  Pattern  Analgia 


Brans  comb,  1979 

Br«nn«r,  B/anscomb,  and  Schwarts,  1979 
Brenner,  Branscotnb,  <v»d  Wright,  1979 
CsQ&iings,  1979 

Cannings,  Borland,  Hill,  »*d  Nicholson,  1977 
Dahm,  1974 
Edaon,  1976 

Pujilisrs,  Sakurai,  and  itakimoto,  1978 
Harris,  North,  and  Owens,  1977 
Inbar  and  Sden,  1976 
Krads,  1974 

Kuroda,  Firjiwara,  Okamura,  end  Utsuki,  1976 

Lieberman  and  Michaels,  1962 

Older  and  Jenney,  197S 

Pasta  oofy,  Opneer,  and  Hyndman,  1976 

Potempa,  1969 

Schiflett,  1979 

Schifkett  and  Lcikith,  1979 

Simonov  and  Frolov,  1977 

Williams  and  Stevens,  1972 
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Air  hut  in,  1977 

Allpart,  Antonin,  and  Reynolds,  1972 
Alluiai  and  Morgan,  1969 
Alluiai  and  Morgan,  1971 
Anderson  and  Chiou,  1977 
Asial.a,  Loy,  and  Quinn,  1969 
Banrick,  Noble,  and  Fitta,  1954 
Baron  and  Leviaon,  19?  5 
Baachera  and  Grandjean,  1979 
Bate  and  Self,  1968 
Baty,  1971 
Beatty,  1976 
Beatty,  1979 
Eell,  1978 

Benel,  Coles,  and  Benel,  1979 
Benson,  Huddleston,  and  Rolfe,  ly65 
Bergstroem  and  Am  berg,  1971 
Blcszczynski  and  Kozerenkc,  1977 
Boyce,  1 974 
Boylan,  1974b 
Bradshaw,  1968 
Branscomb,  1979 
Brecht,  3  977 

Brenner,  Branscomb,  and  Schwartz,  1979 
Brenner,  Branscomb,  and  Wright,  3  979 
Brichcin  and  Hampejsova,  1 970 
Broadbent  and  Heron,  1962 
Brown,  Stone,  and  Pearce,  1975 
Burke,  1979 
Cannings,  1979 

Cannings,  Borland,  Hill,  and  Nicholson,  1977 
Catlett,  1973 
Ceder,  1977 

Cha inova,  Komarova,  and  Zonabend,  1970 
Chiles,  Jennings,  and  Alluiai,  1979 
Chu  and  Rouse,  1977 

Clark,  Arnold,  Foulds,  Brown,  East  mead,  and  Parry,  1975 
Clement,  McRuer,  and  Klein,  no  date 
Cliff,  1971 

Cohen  and  Silverman,  1957 
Colle  and  DeMaio,  1 978 
Datnos,  1978 

Damos  and  Wickens,  1977a 
Damos  and  Wickens,  1977b 
Danev,  Radneva,  and  Zlatarov,  1975 
Danev  and  Wartna,  1970 
Defayolle,  Dinand,  and  Gentil,  1973 
Enstrom  and  Rouse,  1976 
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Enatrom  and  Rouse,  1977 

Ettema,  1969 

Ettema  and  Zielhuia,  1971 

Fergenson  and  Gold,  1977 

Finkeltnan  and  Glass,  1970 

Fowler,  Williams,  Fowler,  and  Young,  1968 

Frankenhaeuser  and  Johansson,  1976 

Gate,  Davies,  and  Sm allbone,  1977 

Gardner,  Beltramo,  and  Krinsky,  1975 

Gaume  and  White,  1975 

Gerathewohl,  Chiles,  and  Thackeray,  1976 

Gilson,  Burke,  and  Jagacinski,  1978 

Gobuty,  1978 

Goetres,  1977b 

Goeters,  1975 

Goldstein,  Dorfman,  and  Price,  1978 

Gopher,  1973 

Gopher  and  Navon,  1978 

Gopher  and  Navon,  1979 

Gopher,  Navon,  and  Chillag,  1977 

Gopher,  Navon,  Chillag,  and  Dotan,  1977 

Gopher  and  North,  1977 

Green  and  Flux,  1977 

Greening,  1978 

Guttman,  Easter ling,  and  Webster,  1972 
Hacker  et  al.,  1977 

Hacker,  Plath,  Richter,  and  Zimmer,  1978 
Hall,  Passey,  and  Meighan,  1965 
Harris,  North,  and  Owens,  1977 
Hart,  1975 
Hotsell,  1977 

Hawkins,  Church,  and  de  Lem  os,  1978 
Hawkins,  Rodriguez,  and  Reicher,  1979 
Herman,  1965 

Heua  and  Teichgraber,  1974 

Hickok,  1973 

Hicks  and  Soliday,  1972 

Hilgendorf,  1967 

Hinion  ai  d  Shaughnessy,  1973 

Holland  and  Tallow,  1972 

Hosman,  1975 

Howells,  Knight,  and  Weiss,  1979 
Huddleston,  1974 
Huddleston  and  Wilson,  1971 
Hutcherson,  1971 
Hyndman  and  Gregory,  1975 
Inbar  and  Eden,  1976 
Inomato.  1977 
Ioseliana,  1971 

Isreal,  Chesney,  Wickena,  and  Donchin,  in  press 
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Isreal,  Wickens,  Chesney,  and  Donchin,  in  preos 
Isreal,  Wickens,  and  Donchin,  1979 
Ivanov-Muromskii  and  Luki«nova,  1975 
Jenney,  Older,  and  Cameron,  1972 
Jennings  and  Chiles,  1977 
Jex,  1967 

Jex  and  Allen,  1970a 
Jex  and  Allen,  1970b 
Jex  and  Clement,  1979 
Jex,  Jewell,  and  Allen,  1972 
Jex,  McDonnell,  and  Phatak,  1966 
Jones  and  Schuster,  1970 
Juris  and  Velden,  1977 
Kahneman,  1973 

Kahneman,  Beatty,  and  Pollack,  1967 

Kahneman,  Tursky,  Shapiro,  and  Crider,  1969 

Kalsbeek,  1968 

Kalsbeek,  1969 

Kalsbeek,  1973b 

Kalsbeek  and  Sykes,  1967 

Kantowitz  and  Knight,  1974 

Kantowitz  and  Knight,  1976b 

Kantowitz  and  Knight,  1977 

Kelley,  1966 

Kelley  and  Wargo,  1967 

Kennedy,  1975 

Kennedy,  1978 

Klein  and  Cassidy,  1972 

Klein  and  Hall,  1975 

Klotzbucher  and  Roloff,  1977 

Krivohlavy,  1968a 

Kundiev,  Navakatikian,  Tomashevskaia,  Derkach,  and  Kovaleva,  1976 

Xuroda,  Fujiwara,  Okamura,  and  Utsuki,  1976 

Lane  and  Streib,  1977 

Laurig  and  Phillip,  1970 

Lawrence,  1979 

Levison,  1970 

Levison,  1979 

Lieberman  and  Michaels,  1962 
Logan,  1979 

Lorens  and  Darrow,  1962 

Luczak  and  Laurig,  1973 

Luczak  and  Rohmert,  1976 

McCauley,  Kennedy,  and  Bittner,  1979 

McDonnell,  1976 

McFeely,  1972 

McGrath,  1969 

Merhav  and  Ya'acov,  1976 

Michon,  1964 

Michon,  1966 
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Milord,  and  Perry,  1977 
Monty  and  Rubin,  1965 
Moray,  1967 

Morgan,  Oates,  Alluisi,  and  Kirby,  1973 

Morriasettc,  Ciannell,  md  fwitzer,  1965 

Mulder  and  Mulder-Hajonides  van  der  Me  u  Jen,  1973 

Nakamura,  Okaue,  and  Hori,  1974 

Navon  and  Gopher,  1979 

Negoescu-  1979 

Noble  and  Trutnbo,  1967 

Noel,  1974 

Norman,  1975 

North,  1977 

North  and  Gopher,  1977 
Noyer,  1971 

O'Conner  and  Buede,  1977 
Offenlock,  1977 
Ohhara,  1970 
Opmeer,  1973 
Owens  and  Harris,  1978 
Parks  and  Springer,  1976 
Payne  and  Buck,  1979 
Phillips,  1976 
Price,  1965 

Price,  Honsberger,  and  Ereneta,  1966 

Proceedings  of  the  Symposium  on  Man-System  Interface,  1978 
Rashman,  1972 

Repko,  Loeb,  and  Brown,  1974 

Replogle,  Holden,  Gold,  Kulak,  Jonas,  and  Potor,  1971 
Roediger,  Knight,  and  Kantowitz,  197V 
Rohmert,  Laurig,  Philipp,  and  Luczak,  1973 
Rouse,  1977 
Schick,  1976 

Schiffler,  Geiselhart,  and  Ivey,  1976 

Schiflett,  1979 

Schiflett  and  Loikith,  1979 

Schori,  1973 

Schori  and  Jones,  1975 

Schvaneveldt,  1969 

Schwarz  and  Ekkers,  1976 
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